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ABSTRACT 

• . . The twoyreports presented here describe an 18-month 

P l°lt ct i n t ende d to review and evaluate the first year's activities ' 
of the Office of Telecommunications Policy's (OTP) Telecommunications 
Demonstration Program /for the delivery of social and health services; 
develop^ approaches for evaluating individual demonstration programs 
in the future; identify factors that have an influence on the 
successful institutionalization and transfer of ' innovative uses of 
telecommunications; and provide information on which to base future 
actions for program development and offer recommendations concerning 
future roles for the program. The first report provides an overview 
of telecommunications and the delivery of services; an overview of 
the Telecommunications Demonstration Program, including OTP's 
legislative mandate, demonstration program objectives, demonstration 
projects and other program-related activities, issues and problems in 
tunding and administering projects, and prdgram strategy 
implementation;, planning and evaluating demonstration projects* 
institutionalization and transfer of demonstration' projects- and 
recommendations for improving the program. The second report/ which 
is in the form of an executive summary, provides a brief description 
of the project methodology, a review of the 12 demonstration pro jects 
undertaken by a variety .of institutions including . services offered 
and technology used, a 1 summary of program activities, a discussion of 
planning -and evaluating demonstration projects and barriers\to their 
institutionalization, and transfer, and organizational, policy, and 
project 'recommendations. (LMM) « . ' 
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EXECUTIVE SUMMAkt. 




tilers 



report is the second in a series of reports submitted 
rice of Telecommunication^ Policy (OTP) of the 
Department of Health f Education ^nd Welfare (DHEW)- in response 
to RFP'147-78-HEW-05;* The goals of ±he* contract, awarded to 
Kalba Bowen Associates *in September 1978 , ' were to* (1) review s 
and evaluate the first-year activities of OTP 1 s Telecommunica- 
tions Program; (2) develop approaches for evaluating- individual 
♦demonstration projects rin the future; . (3) identify factors 
that have an influence on the successful institutionalization 
and transfer of innovative uses of telecommunications; and 
(4) provide information on which. to base 'future -actions' for 
program development and offer recommendations concerning '. , 



pm^rit 

future roles fcjf5rthe Program. 

This volume summarizes the findings of Kalba. Boweri 
Associates 1 one-and-a-half year inquiry. Sections of the 
report present an overview of "current and future applications 
of telecommunications in tKe social service delivery context; . 
review the evolution of the Telecommunications Demonstration 
Program; describe effective planning and evaluation activities 
and recoifimend cost-analysis and data* collection procedures; 
and examine the factors inhibiting' the transfer and institu- 
tionalization of demonstration projects. \The report concludes 
with a series of organizational^ program ^pb licy / and project 
administration and oversight recommendatioj?^ for( improving 
/the ProgramA 

Other reports resulting^Srom Kalba Bow 
research include: v ' ■< 




Associates 



• Evaluation of Telecommunications Demonstration Projects 
and Recommendations to the DHEW Telecommunications "7 



ms 

Demonstration Program ^ Executive Summary Report #14 6- 01 

'Evali ^tiort; of Telecommunications Demonstration Projects 



and Recommendations to the DHEW- Telecommunications 
Demonstration Program ^ S umniary - Report #146-02 - ~ " 

• Strategies for Institutionalizing Telecommunications 
Demonstration^ ; » A Review of Innovation Barriers and 
/^ Program Alternatives , Final Report #146-04 : ~~ T 



. */ During the preparation of the final /Reports 9 OTP was 

moved from DHEW to the Department qf Education. While, 
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in some cases , the impacts of this 
within the context of the reports, 
the most part to refer to. OTP/DHEW 
location of the Telecommunications 
at the time of our research. 



love are discussed 
re -have chosen for 
jihce this was the 
demonstration Program 
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X.O INTRODUCTION V . ' 1 

■ " ■■ ■ • ' . y4 •' " ■ , ■• ' 

In X976 Congress created the; Telecommunications Demon-* 

'■.*■■ * 1 

stration Program in the Department o£ Health , Education and 

Welfare to demonstrate the use of non-broadcast telecoiranuni- 1 

* * * • *■ * ■ * * 

cations technologies in the delivery of health, education 

and other public or social service infprmation; Since its 

* * ■ . . . . 

inception the Program has'/f untied-, a total of fifteen* projects 
in three funding cycles. This report summarizes the ffir&t • 
effort at reviewing and evaluating the Program, ji^jpf^lrmed > 
6y Kalba Bowen Associates during 19 78-79 . 

When the study began, the Program was still in, its > 
formative stages; eight projects had jDeen funded aiid were 
just completing their first year of effort with various , ^ 

levels of success in getting th^ir demonstration systems 

> * „■>•*•<' * * * * , 

installed ^nd. in operation. The project team reviewed each 
• ./ ' . )V, ' . • . ■' ,' • . 

of those projects. 4 ^TJlvus, in addition to examining the Pro- 

H '* ' • . ' . ,\ 

gram as a whole, theystudy team has given attention to .the ' 

process of conducting and evaluating demons trations. As a 

result two r additional reports have been prepared; one focuses 

on^ methods and procedures .for developing and analyzing in-? 

dividual demonstration projects— ^ and the second examines 

■ - ■ ■ ^ . .. / - ■ . ; ' • 2/ 

institutional factors affecting the success of demonstrations.— ■ 



1 / Planning and Evaluating Telecommunications .Dempnstration 
, - Projects ,' and Assessing the Costs o'f Telecommtanicatioi^&> . 
Demonstration Proi ects , Final Repgrt #14^6-03, Kalba Bowen 
Associates, Inc. ,1930. . ~ * 

2/ Strategies for Institutionalizing Telecommunications Demon- ^ 
" strations: A Review of Innovation Barriers and Program 

Alternatives , Final Report #146-04; Kalba Bowen Associates, 
Inc. , 1980. 7 ~ ' '.r 



: The Telecommunication s Demonstration Program; is 
/entering its third. year of operation. The initial " ^ • 
group of ^roj ects funded will enter their? third and final 
.year of '.program s uppor t . , Unti 1 now the Program has had to 

concern itself primarily with selecting and monitoring v ; 

» * ./ > 5 . , « • " . 

projects. With projects maturing it Vi 11 have to devote \ 
considerably more time to its role in assisting the. transfer 
and institutionalization process of the innovations it has 

o » * ■ . " 

supported. Additionally, the. Program is facing reorganization 
into, the new Department of Education. • The nature and extent 
of the reorganizatioh §J?eTuncertain. Thus, the Program 
itself is still developing. The ideas and recommendations 
presented in this summary report are* intended to assist 
^he„ Program as* iL continues ^o mature ^Xj ^ 

Section f 2 ^ofy this report, presents an overview of the 
evolution and use^ of telecommunications, in the social sey- 
vice delivery context. Jt discusses cur r^nt^^ii cations 
£nd then comments on potential telieconununicatibnsAXapplicar 

: . ' ■ • i " / • • 

tions in the coming decade. ■ 

» , ^ S • »• i * • ( 

< Section 3 reviews~the Telecommunications Demonstration 
Program. It begins by explaining - the' Program's legislative 
mandate, and then Reviews the Program's objectives,, demon- 
stration project's funded, and other activities related to 
the Program. Following this review, the major issues and 
prqblems faced by, the vProgram in selecting, and administering! , 



thje projects, are identified, and the Program's response to 
these ;issues lis analyzed. In' the cojur^e of conducting 
tfyis*£naiysi&, the basic program strategy fori promoting 
e use of telecommunications is summarized. 



| '^Section 4. focuses on the role of planning and eval- 

Ration activities as they relate to telecommunication? 

/ i * • ^ " . 'v.- ■ 

demonstration projects. , It points out the importance -of 

/ ' " *■ . ■. * \ . ■ * . 

-using pinning and evaluation activities in 'helping the 

Program to more effectively promote the use of telecoitmiuni- 
cations' in ^social service delivery. It is f ollowed by , 
recommendations for cqst-analysis and data collection pro- 
cedures vtiich are brief iyappiied to those projects that 
had generated suf f icient -ds&a to -permit an analysis to be 
conducted. . & ■ 

Sect^oh^S brief ly examines, the factors inhibiting the 
transfer ^nd institutionalization of demof^ltration pro- 
jects. Barriers to successful institutionalization and 
transfer are identified through *a review of the literature 
on demonstration projects cpnducted by other programs °and 
agencies. Based on this review several options for the 
DHEW program are identified. ' ; 

The- report concludes with a section summarizing the * 
major issues identified during the course of this study 
that now confront the Telecommunications Demonstration 
Program. Broadly,; the issues, can be categorized into three 




groups ; organization, progpam policy i and project ad- / 
v , ministration and oversight.' Recommendations for impro- 
Viy^-ng the Progr4m are then presented. . / ' 




2/0 ,AN OVERVIEW OP TELECOMMUNICATIONS AND 'THE DELIVERY 
OF SOCIAL AND HEALTH SERVICES - • 

* * • 

2 «1 Overview of Telecommunications Applications 

Non-broadcast telecommunications technologies are 
forms of communications technology that employ discrete 
transmission channels for the transmittal and reception 
of information (audio, image, and/or textual)". In , ' 

» . * 

contrast to broadcasting technologies, nbn-broadcast 
telecommunications typically permit a more interactive 
and^ targeted form of point-to-point communications among 
a known\ne£work of recipients. More than anything else , 
it is the\ capacity to reach specific audiences that dis- 

tinguishes \nqn-broaddast technologies from other forms \ot 

- \ : • . . \: i 

telecommunications. 

\ v . « 

The cost/performance ratio of communications and 1 )f 

computing has improved dramatically, due to improvements 1 

over the last decade in the transmission capacity of 

telecommunications conduits (specifically, coaxial cabl^V 

and now fiber optics and other high capacity transmission 

techniques, such as satellites) , as well as major advances 
- i ' . ■ ''I 

in computer technology (Large Scale Integrated Circuits). 

Thus, there has been an. intense interest in identifying / 

those application areas wherey new* telecommunications I 



capabilities could be exploited to reduce costs, increase 
access and/or improve quality in the delivery of health, 
education and social serviced. ± 



■ * 
Advances in new telecommunications (and later in tel£ 

processing) technologies are generally .thought to provide 

the following types of savings and efficiencies: 



m • cost reduction and/or efficiencies in , 
information preparation, dissemination 
and distribution activities through 
facsimile, ielectronip^riesSage systems , 
satellite distribution\§yg terns, cable 
television,^ interactive cable-, and other 
telecommunications technologies; 

. • more timely use of information re- 
sources and technical skills by havihg 
health, education and social service 
professionals employ telecommunications 
methods for consulting, diagnosis*, 
referral, and the direct delivery of 
services over telecommunications 
channels; 

\ improved outreach to disadvantaged and 
remote populations by linking health,^ 
education, and social service professionals 
thjo&gh cable, microwave, telephone, 
and satellite channels to groups and 
individuals not readily accessible < (e.g. 
the elderly, handicapped, rural popu- 
lations, and inmates); 

• improved distribution of educational 
materials and programs througlf^cable 
television, teleconferencing, and 
computer conferencing;* 



iO . 



• ^proved managerial and administrative > 

productivi ty throilah telprnnfpr ft nnin gj ' 

teleprocessing, and information manage- 
ment-electronic mail and distributed , 
processing techniques) 

• economies of scale bv having different « 
user groups share a common network and 

capital equipment; and 

• specialized services for- the blind, deaf f 
and incapacitated that otherwise could^ 

not be available or technically -possible; a 

. . ■ • • ■ .. > 

V- ^ iven **** Potential of new communications ' technologies 
to improve the delivery of services and education, the 
question is how to design, adapt, and harness these tech- 

* * ' ' \ \ ' 

nologies to the specific goals, resources, and environments 
of health, education and social services. Although it is* 
easy to. envision the potential of telecommunications for ' 
service delivery, it is quite another matter to adapt tech- 
nologies /to the needs of .the serVice community,, to gain ' 
the support of necessary professionals and public agencies, 
and to. institutionalize these services on a self-supporting 

.9. / 

and cost effective basis/ '. ' 

While there has been an acceleration in publd£ service 
use of telecommunications in recent years, telecommunications 
has yet to take a permanent hold as a major vehicle for the 
delivery o.f health, education, and social services. In Cost 
federal, state, and local public service agencies,- the\/ 
term "telecommunications" is skll identified with tele- 
phone services and has yet. to break out. of this narrow 



definition of its potential applications and uses. How- 
ever, telecommunications and information processing 
services - ate in the next decade likely [ to assume a more 
ccitic^l and central function in the management and line' 
opferations of service agencies. The principal difficulties 
will be in creating the organizational, and institutional 
changes needed to allow for utfe o£ r communications and . > 

information functions and facilities. ^ 

' " . : • ' ' . " 

WhileVit is not possible to break down federal, st:at;e, 
and private expenditures currently made to teleconuifiinications- 
supported services, it is- apparent that telecommunications is 
playing an increasingly important role and that the quality, 
"scopfe, availability, arid cost. of hearth, education, and 
socSial services depends in large measure upon^maintaining* 
..and improving telecommunications equipment. Moreover , it, is 
also apparent that a*variety of administrative, financial , and 
service delivery functions may be improved^through enhanced 



communications and information proces^ingHSapabilities and . 

that these improvements would not only affect a wide 

... ' ' . . ' ' 

range of health, education, and social services , but also . 

impact populations with particularly strong needs, the 

elderly, handicapped, and the disadvantaged. However, in 

order to fully exploit the poteS^ial economies, efficiencies, 

and increased capabilities of new telecommunications-based 

services, major innovatibns^in the^ay service providers - 



8 ' 12 - ' 



v.. . cddceptualize and administer their services r a$ well as- 
in how end users unders tand their ne^ds, must, be made. 

2. 2\ Future Applications of TelegoinmuniGatibns Services^^ ' - 

The 1980' s ' are predicted to; be the decade in which 
: \ma jbr conimunications arid computer innovations find 'their "V 
, way intb every hpme and business i- However , based upon 

similar, prophesies in the past, it is fairiy 6afe to say ' 
/:,^Uia1:.;the- rate of change will probably not be as fast as 
projected. Whxle "the more affluent and innovative sectors 
of society soon may use 'fiber optics , direct broadcast 9 
satellites, jjii^rocqmpu^ and other such 

techridlo'gies'in pursuit of the "automated office" ar^.ttie ? 
"integrated home information arid entertainment center" • ' 
the majority of society — particularly the public' service ' 
sector and- less affluent groups, -- will be slower to exploit 
such advances.; 'The reasons are a ttitudinal, economic/ and 
institutional.. Technological changes that require addi<- 
tional expenditures and alterations in institutional attitudes 
and structure, even highly beneficial ones, are resisted. 

Thesji* issues will affect how and who will use tele- 
communications in the future for service delivery. In 
light bf the commonly-made observation that innovations - K 
proceed in a step-wise rather than leap-frog fashio^ one 
( can expect those service delivery functions to ^evolve in 
communications where current capabilities arid resources 
are most receptive to the next increment of change. 
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Whereas deWonstrat ion projects might show what* is possibl'e in 
a specific environment, the actual adoption and institution- 
alization df an innovation requires approval of 4 widet array 
of people and a continuity 7 ^ habits , v skills, resources / and 

incentives, • • > .' , ' t "" : v \" : ' . 

v y V ; , -■ ' -^v/A' ^ ', - / "V //S, 'V.;'" / . v ->;;^' 
We -do hot foresee the eighties as being- a^decade in which 

a great leap forward is made by service providers into the 

state of the art technologies of ithe "communications age" . 

Rather we envision a period in whicfh public service useS^of 



current telecommunications technologies are upgraded, expanded 
and made more efficient. Moreover, we would expect that inno- 
vat^pns in the public service sector would by and large follow 




those ^n the private sector , with thbse programs and" service 
providers with the technical and financial resources/ and the 



incentives being/tihe leaders. 1 Additionally ,\ as in/ the case of 

■ . — ■ , :: ... ■ <■ ■ ;-i .. . / . - - 

the private sector's use of telecommunicatiorts ft>r managerial 
and service delivery purposes, we expect the relal bottlenecks 
not to .be the cost or availability of hardware ) but rather 
(1) the availability of relevant ' and reliable software — not 
only for the production, management, and /distribution of 
information, but also for producing program material for a 
broad range of educational uses; (2) /the problems of public 
decision-making in times of tight resources; and (3) the need* 
for bhanges in human and institutional behaviors. 

For these reasons we foresee the following types of / 
innpyations as having the greatest potential for enhancing 



the delivery of health f educational and social services ill 
the near t^rm: .■<.•.••':> 

" A ' improved teleconferencing through 
^ : innovations \irir speaker phones, video, 
. ' and teleconferencing, methods ; * , .• 

• , t v • electronic message systems and 

'document distribution- which w-i n Vp^q ' 
. the cost of.- document "preparation and * 
Wji;;; • ; distribution. 'Terminals will be- ' 

.'• '9-'i:f ^ come more widely available and easy *.'•;.;•:' 
. . " >fc:]to use;* ~more and more information • 

' / wi 11 be 4 n f le ct. r priic form; ;• ... . • 

• lo^-cost satellite stations allowing 
f. for more extensive use of broadband ' 
/communications 'for text, audio, and 
. t ■ 7 video; •" "xV-vtX;.' " : ; ; \"v ■ - 

• ••/ growth of services offering ' ' v 

L / and information for research, manage- 
»F ment, education, and training; % K 

reduced" networking costs for data , 
facsimile, voice , and to some ^-degr ee 
video transmission; data network ser- 
vices will become more "widely 
I available; 

(• distributed processing as the rednrpH 
/ cost of microconputers; increases - 
/ the use of databanks for a wide range 
/ of information management fuiKJtiohs ..' 

The above telecommunications .and computer advances 
are close to being widely available today and are likely 
to affect the following types of support services: ' 

• program/project management and coordination 

• record keeping, billing, and payment 

• staff training and supervision \ 

• travel costs and time > • 

• information dissemination 
•scheduling and announcements 

• publication and document distribution 



• information \cqu^ition • v 

• research " * . ^ 

; • 109ation>of field and satellite offices " . 

•• resource > • v ' V - 

V • f inancial and budgetary control^ . 

• ; With respect to- the direct: delivery of services, we A 
anticipate the Impact of telecbnittuinications tip be the greatest; 
iil thpse areas in wfitich need is either highly manifest or 
where no alternative exists. This suggests that telecommuni- 
cations will play a particularly important role in helping " 
th^ handicapped — the blind, deaf , and physically disabled. "\ 
Telecommunications is also likely to play a major role in 
servicing 'isolated/populations, such as rural groups, the, 
homebound , the elderly / outpatients , and pri son inmates . * Be- 
low are some of the direct service applications one can ex- 
pect to see receive more widespread use in the 1980"s: 

• electronic message systems for the deaf 1 - 

• te leme trie prosthetic devices V 
■ s • interactive^ education* . 

v ' • direct distributiph and access of client- 
specific information V 

• improved heaith cafe monitoring 

• ^interactive /reading machines for the blind 

• improved interactive computer assisted 
telediagnosis ■ 

• instantaneous referral 'and scheduling 

• v improved computer-aided instruction 

• user accessed service delivery systems 

• automated announcement services •-' 

• placement of low-cost service dislivery 
terminals in the home 

• • telemetric instruments for remote' i 
diagnosis and treatment. 

While these types of applications will be technologically 
feasible in the near term, they will require major adjustments 

i 



•:> • • = ,••••,.•. \ . . v ; ; . . ■ ■. ; ,. .;. ■ •• . 

on the part' of service providers and clients and therefore 
will not occur automa^cally or of their own accord.; sig- 
nificant institutional changes and innovations will be ;'V< 
required^ over time in order to* encburage- different agencies 
to pool their resources and skills to take advantage of the V 
potential economies of scale 'and service opportunities of* 
the eighGes. . '» . . 9 r : ' 




% ■ 
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3.0 AN OVERVliEW OP THE TELECOMMUNICATIONS DEMONSTRATION ' \ 
• ' program .. I ',,••/■ : , 

3.1 OTP 1 a Legislative Mandate * , ' " ' ' 

. • In Jane, 1976 Congress passed the Educational Broad- •«»'*/ 
casting Facilities and Telecommunications Act (P.L. 94- ' 
309, 47 u.S.C' 395) creating the Telecommunicati'ons Demon- 
stration Program s in the Department 6f Health,, Education/** r 

■ ' :•' -. ' .'.i: .V".\-< ' • - - 

and Welfare (DHEW) . The Telecommunications Demonstration ' 

: ' ■ '' V' ;V " -f '••J"':- ?•:' ^V*.V 

Program, which received its first appropriation in Sept- 

)■ • \v..\-"' .'A- ; 
ember, 1977, is administered . by DHEW's Office of Teiecom- 

•.'>':• •■; ."■ ■ 'ff : \ : ■' . •••••• : .-. ' v. 

munications Policy (OTP) . ' • V \Lj' ; ' 

The Program's basic legislative mandate is to: i ' ' 

* : •. •. /. '•• ■• '■' :; vv • . •'. 

" • • • promote the development 'of ridn-broadcas t . 
telecoiranunicaitions facilities and services for „ > 
the transmission, distribution, and delivery of 
• health/ education, and public or social service; 
information." 



Other provisions of this Act {!) authorize the Secre- 
tary to fund projects that "demonstrate innovative methods 

■ r ■ - ■ ■ ■ ". ' • ■ " '.y ',. :■<•■• 

or techniques of using nqn-broadCast telecommunications 
equipment or facilities, "-2/ and (2) limit support of 
demonstration projects funded un^der the program to no more 

■ . — — — \' ; '- : w«$r 

3 / The term "non-broadcast telecommunications facilities " is 
defined in the legislation as including, but not being 
limited to: ; : 

"cable television systems , communications j a tel lite 'systems, 
and related tejnninal equipment, and othe^mqthods c*f trans- 
mitting, emitting, or receiving images," sound, or intelli- 
gence by means of wire, radio, optical, electromagnetic > 
or other means . M 



than three years. In addition, the Act specifies (3) that 
the faciliites and equipment acquired and developed be used 
"substantially" for the transmission, distribution, and 
delivery of health, education or public or social- service ' 
and (4) that the control and administration of a demon- 
stration project is to be left in the hands of the'appli- 
cant, including the evaluation of results, conducted at 
least once' a year. 

• . • • ■ ' » y ■ . . 

For historical reasons responsibility for administering. 

the Telecommunications Demonstration Program was given to the 

* '• . * ■ « * 

OTP, which had been actively involved in drafting and getting 

passed into law the Program's enabling legislation. The 
OTP was established in 1970 to act as an advocate for 
social . service interests in the « formulation of telecommuni- 
cations policy' and as an advocate of appropriate applications 
of telecommunications in j the delivery of health, education 
and social services. It was placed in the Office of 
the Assistant SecretarY^K^r Planning and Evaluation 1 
largely because of *the "cross-cutting" nature of tele- 
communications policy and applications of telecommunications 
technology which involved all three agences in DHEW. In 
its early years the OTP focused primarily on policy issues 
and served as an advocate for social service uses of 
telecommunications. Its role as an advocate in the formula- 
tion of telecommunicatjLons policy w^s accomplished largely 
through involvement in inter- and intra-departmental 



committees andother liaison 'activities. Although ori- 
ginally OTP had no program administration responsibilities, 

f it played, a Jmajor role in coordinating the ATS-6 satellite 
experimehts t which lead to the establishment of. the .Public Ser- 
vice Satellite Cbnsortium. In part as a result of its experi- 

- ence with ATS- 6 ,. the} OTP , therefore , took on a much stronger 
programmatic focus with the enactment of the legislation 

Establishing the Telecommunications Demonstration Program. 



I While its, staff members are sti^ll involved in inter- 

agency comtnitteeis and activities^ the 6tp^ow serves its 
advocacy role more through . its inVoiy^fient with deirtons tra- 
tion projects tfyan through direct policy formulation acti- 
vities. This is due to the demands of administering the / 
Tel096nmiunications Demons traticmjjprogram, a decline r» staff , 



Y 



and the fact that some of the currekt staff members have res- 
possibility outside the tielecoiwhunicatidns arena. Thus/ the OTP 
has evolved from a group whose primary focus was advocating 
social service interests in telecommunications policy formula- 
tion and telecommunications . in social services to a group which 
has ^assumed programmatic activities with policy implications. ^ 
It is. not yet clear how OTP's recent move to the Department 

of Education (ED) will affect its status or focus. 

* ~_ 

3 . 2 Telecommunications Demonstration Program Objectives 

Although the Telecommunications Demons terat4on Program's * 
mandate is clear in its intent to fund individual demonstra- 
tion projects/ the language of the Act is sufficiently 



ambiguous to allow considerable latitude in determining the 
specific objectives a» the demonstrations and activities of . 
the program. tfrom the 'beginning there have been extensive , 
discussions among the staff, the working group and the review 
committee on the goals of V the Program. These discussions have 
been based on these participants' understanding of OTP's long- 
standing policy, emphasis; however, the .transition to explicit 
Program objectives is not yet complete. - ' - 

\ While no formal statement of specific program objectives 
has been drafted by OTP, several implicit objectives have' 
evolved during the Program? s first three years. These have 
been identified through interviews with the program staff 
and a review of published OTP regulations. , 

The OTP is seeking to: \ * > * 

(D fund projects ^ that use existlnq; technolo- 
gies in innovative ways . The public service 
applications of telecommunications tech- v 
nalogies are behind those of other fields 
and should be built up by increasing 
experience with existing" technologies. 
1x1 addition, restricting demonstrations 
'to fully-developed technologies eliminates ' * 

additional unnecessary risk introduced by 
unproven technologies; 

(2) emphasize the use of appropriate technology 
for service, delivery . It Is important to 
. avoid % forcing a technology into use as a 
service delivery mechanism. The approach 
used by the program staff is to focus on 
innovative methods of , service delivery as 
perceived by the providers and clients 
involved and then to demonstrate technologies 
that are likely to play a useful role. 
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' " *' (3) » q ?*«? atea user demand for costly foh- 
noloqlea . service delivery using tele- 
. ; conununieations it of teh capital-intensive . 
The; shared <uee^ 

for several Hindi of service delivery, or^ 
by several groups or agencies for the same v 
services, reduces the cost to any one user; 

J ;<.4) actively participate in the ..Innovation dif- ' 
| i , fusion process and educate ite constituency . 
r /' concerning the potential value and uses bf 

telecoromunications for social service de^~ " 
• | livery . promotijig the development ^of tele- * 
i I communications *f©r service delivery as man- > 
\ j dated by the legislation involves more than- ' 

I f " just funding projects and disseminating the 
I results through publications. It means 
j actively advocating the further adoption of 
.'A the concept or system demonstrated. Among 
the. Program's constituents are the federal 
health, education, and welfare service de- 
livery programs in DHEW, other agencies 
involved in telecommunications such 
as the NTIA and- the FCC, state and local 
agencies and the client groups themselves; 

.; <5) fund demonstrations that show promise of 

continuing on their own after Program funds 
'. . * are discontinued . While many demonstrations 

are primarily viewed as short-term experiments, the 
Program is oriented to supposing projects 
that will continue to develbf^and grow to the 
point where fhey are institutionalized in the 
setting where they began^and beyond. ' - 

These five objectives are reflected in the criteria 
for the selection of demonstration projects published when 

c 

• the Program began. These objectives have come more into 
focus over time, and as the projects continue to develop 
and the Program matures, they can and should continue to 
become more specific. The initial projects are only, 



* 

; r. 
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now completing a three-yea* funding cycla\ There is 
still experience to ba gained oonoaming tha process of 
transferring successful demonstration concepts to other 
locations and/or types of services. \' 

-3»3 Demonstration Projects and Other. Progra m-itelatad 
Activities : ■ ~T7 ■ ' 



The Teleconpunication8 Demonstration Program is 'now in 
i its third year of operation'. From^dts^.nception, interest 
in the Program hasybeen high* with requests resulting from 
the grant solicitation- increasing from 5Q0 in its first L » 
funding cycle to over 2,000 in the current funding year. 
Of the 500 applicants who requested the grant solicitation ♦ 
in the first year, ninety-five proposals were submitted and 
eight -pro jects-^were funded (January, 1978). in the second 
year there. were 1,600 requests foy the solicitation. Of the 74 
proposals submitted, five were funded (December, 1978) . The 
Program received more than 2,000 requests for its third 
funding cycle; 113 proposals were, received and two awards 
have been made to date (March 1980) . ^ 

The fifteen currently funded projects involve a variety 
of information services in the health, education and welfare '\ * 
areas. Although no; projects have completed the maximum 3 
year funding cycle, some have already shown positive results, 
while others have performed inadequately . (See Appendix A) . 
Considered together, they illustrate the ability of 

' *. . 
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^telecommunication! t;o "out aoroii M ' institutions' and typea 
. of aarvioa in tha da li vary of information services. For 
example, of, the fifteen grantees, six are educational in-., 
•titutipns, fiva ara haalth-ralatad 'institutions and four" 
are no n-proji't'' service organisations. More importantly,, » 
the- typaa of., aarvicaa -involved apan the health, ^education - 
and welfare fields. Five projects are primarily educational 
applications. Three involve telecommunications in the 
delivery of medical services and seven projects involve the 
delivery of infornfation services to special populations such 
as the deaf ^r migrant faint* workers, " * 

Several projects also demonstrate) this "cross-cutting" 
character internally. For example, the computer-assisted 
telecommunications project for the deaf (Deaf Community 
Center) demonstrates not only the use that electronic message 
services have for the deaf community, but also involves edu- 
cational programming provided through- a local hospital on\ * 
health-related subjects" and news services from the local pub- 
lic television station. 

" . / ' 

Of the eight demonstration projects funded in the first * 
year (January 1978) and evaluated by Kalba Bowen staff during 
1979, two projects had successfully completed their de- 
monstration objectives. These were(l) the Telecommunications 
Division , State of Alabama .(a state agency), and (2) the 
University of Denver Graduate School of Librarianship . The 
Alabama Telecommunications Division received funding to 
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demonstrate, tye use o£ UHP radio' And telephone for mobile 
communications among emergency medical personnel in rural 

., wot tern Alabama 1 Aa requested, the Demonstration Program 
provided funding for. only one' year for the equipment pur- 

^ Chase .of a portion of the demonstration system. This sys- 
tem, has performed very well.' It. is expected that it will 
be used as a standard for other emergency medical services 
that may be constructed in rural areas throughout the 
United States. Even if it is not adopted in a great number 
of other locations, the demonstration served ite purpoae of 
helping to focus attention on an . innovative system for 
delivering health services. The Division of Emergency 
Medical Services in the DHEW, a co-monitor of the project, 

his taken great interest in the demonstration program. ** 

- ( * 
The University of Denver received funding for a pro- ••■ 

• . v 

.ject employing telefacsimile and slow scan TV to share infor- 
mation resources among libraries in remote areas of a multi- 
state region. The project formally ended November 30, £979, 
but its demonstration phase, was concluded six months earlier. 
<(The final six months were spent on development of evaluation 
and dissemination activities) . While the project did not 
prove feasible for .continued operation, it was successful in 
gaining the interest of library staffs in remote areas where 
access' to larger. collections is critical. The slow scan 
feature, while useful, needs increased automation and higher 
resolution to make it an effective ±col7^nd-telefacsimile 
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was found to be of value only if <a sufficient volume of 
information was fransmitted. The library could not gener- 
* ate adequate system usage during tho « demonstration to make 
it cost-effective, and the network established during the , 
demonstration is no longer operating. However, the results 
were shared with regional library groups in the western 
states which are exploring possibilities for networking in 
their regions. , 

The ayatem has raAied a series of intereating questions 
which apply to short ^B^long-term policy considerations! 

• which informat^f^sequests are truly .time 
critical and how can this be measured; 

e how are costs to be allocated' for information 
services and should there be charges for . 
services? 

e what are the most effective technioues for 
marketing library services; 

e what are the long-term effects of quick 
information access on both the library and 
the community; and, 

• what effect will telefacsimile availability 
have on decision-making in communities remote 
from information sources? 

Four projects have received continuation grants. They 

* * J r ■ 

are: (1) the Deaf Community Center, Framingham, MA; (2) the 
Center for Excellence, Williamsburg, VA; ,(3) Pace Institute, 
Inc.", Chicago, IL; and (4) Pennsylvania State University. 
The Deaf Community -Center , a private non-profit service 
Organization, received third year funds (March 1980) for the 

4 ■ • J * 

. . . v . • V ■ " • . \ 

23 26 . ; '". 



continuation of a computed- as si s ted - te leconununications . pro- / 
ject illustrating the usefulness of electronic, message sys- 
^ems to ; toe The funding of ^is projfct^ ^ T 

has created interest in DHEW' s Bureau of Educatibh for. tiie' 
Handicapped (DHEW/BEH) and. has had some influence on- that 

-•' •■ • ■:. / . ; f^^;c?;;;.,.-:v..--'-.:a:'.-- ; /.'-.: ..v,^ ■ ....'-...v,-.. l*.-;.-:,. ■ .- . ■. 

program's decision to conduct ah analysis of • a possible 
nation-wide effort to look mqre closely at tie problems 
transmission incompatibility between teletype (.TTY), and com->/ 
puter terminals: The Frarainghara project is a^o contributing"" 

* ' ' . " * . ~ v . ' • . . . ./.-.•• . •....',■.:*- . .- . ■ • 

to current public discussion concerning communications for 
the deaf. The FCC is : conducting an inquiry into this sub- 
ject and the grantee has 1 preprinted its initial results, de- 
monstrating its system; befoj^ the Commission. The pre- 
sentation is being entered ihto the inquiry docket (Docket 

#78-50) .-i/ ' : , ' ^i' : ' : Pk-'-r- ' ■ ; 

The C enter for Exce 11 ence (CenTex) ; a non-profit ser- . 
vice organization, received third year continuation funds 
(March 1980) for its demonstration using FM Radio Subcarrier 
Communications Authority (SCA) to broadcast local news t" 



_i/ Since the time of our research, ah ad hoc group 

has/ started to look into the pbssibility of incor 1 * 
porating a new non-profit center for 0 computer-aided 
telecommunications for the deaf in Frami'ngham and there 
^>is a strong likelihood that 'such a center could re- 
ceive a grant from the Department of Commerce's Public ' 
Telecommuhications Facilities Program to purchase 
equipment. Thus/ it is likely that the project will 
be fins titutibhalized'' and will continue at the end 
of demonstration funding. 



24 



27 



announcements, entertainmeht^s other information 

services toVthe blind a a special audio .;■ 

receiver, and to thd; 

Although the CdnTex project is successfully conducting 
its demonstration agenda; the future of the concept depends 
on having a relatively large aud^p^ce to make the* service 
affordable. Since legal barriers prohibit the C9mmefcial 
distribution of' the special repeivers required ,o the limited 
purchase and manufacture! of receivers becomes a major im- » 
pediment to service growth. ^ There are also questions 
about the need for the services offered, given the existence 
of local radio and television programming, and* the expected 
imprpvement in services off ered by National Public Radio. 

Pace Institute, Inc. , also a non-profit service organi- 
zation, received third year funding for its demonstration 
involving two-way slow scan television >f or educational 



/ Since our evaluation , CeriTex has begun to expand geogra- 
phically and f share with cither stations , working with 
National Public Radio (NPR) cm nationwide distribution. 
It has negotiated a reciprocal agreement with NPR ' s station 
WYCS tYbrktown, VA) to trade SCA programming materials for 
> the blind and * has a firm commitment to enter into the same 
kind of arrangement with WHRO, (Norfolk, VA) . This will ; f 
k . \ give Williamsburg access to NPR programming materials and 
will enable CenTex to provide their services to a larger 
• . • audience. In addition, CenTex has been granted use qf 

three audio FM channels on each of three cable systems in 
the Hampton Rdad area, and has established new institu- 
tional ties. 

6/ Receivers can now, however, be purchased by NT I A and are 
often provided as a public service or , through philanthropic 
support.' : '■' . ... ■ ' <v.~ 



services for inmates in- correctional institutions The 
project was slow in, getting started because of problems in ?• 
acquiring' its slow scan video system and in project manage- ; 
ment. However, a marked improvement has taken place recently 
with thef addition of vai new project manager and most com- 
ponents of the system are now in place. .PACE foresees iiistitu 
tiOnalization of family visits via slow scan and has plans \ 
to initiate family^ counselling services uafer funding from 
dwier sources. Job interviews arid interview counselling 
will also be institutionalized. The education phase is - 
working well under experimental conditions. V" 

"m , Tbe Werners ville S tate Hospital ,. y£ mental institution ■ : 
in Wernersville, PA, unlike the three previously mentioned 
proj eCts , applied for one Cy ear fun.di.ng fpr equipment purchase 
for a two-way cable microwave lir^1for~use in parent edu- ■ 
cation and rehabilitation programming. A primary objective 
of the project was to demonstrate the use of two-way cable 
television in providing interaction between patients and the 
outside community. Because of issues relating » to privacy, 
special permits were, needed. After some delay, a privacy 
release form was Cleared by the State and the two-way inter- 
connection is* now in operation. This "system is flexible and 
is being used in many configurations beyond community /hospital 
interchanges, such as closed circuit use for patient communi- 
cation and staff training. Not a* great deal of funding is 
necessary from the hospital to continue tj*e system, since 



the, capit:al expenses have been paid 

■ *."•*•'.' ,v ' '■' ' ' •' . * •■ ' ■ v .... • . ■ * . 

. Pennsylvania State University received fanfl i no f^r 
the demonstration of a statewide continuing education .net- . 
work through interconnecting cable television systems* 
(PENietllAMA) . .While PENNARAMA received only, a time exten- * 
sion during the second year without additional f unds r : this; 
past year it again has' received a continuation grant.' The 
demonstration was intended to aggregate demand over a large 
area and, in conjunction with a corfsortium of other Pennsyl 
vania ins ti tutions of higher educatifc, provide programming 
to interested groups which are noi large enough' by them->- 
selves to obtain • continuing education programming. The 
grantee experienced difficulties in assembling the cable 
network, but has recently signed an agreement with a group 
of cable operators from across the state. It must still 
complete this network and demonstrate that dispersed u^sers ' 
can be aggregated in sufficient numbers to support network 
programming . 

.-■ . .. ' ■ ■ ■ . ' : ; 

The Extension System, University of Wisconsin received 

funding for a demonstration to develop dial- ue> information ' 

services for the general*public. Like Pennsylvania State 

University it did not receive second year funding, but has 

received third year funding to complete the demonstration. 

At the time of our initial research, this project had yet 

to operate because the technology required was not avail- 1 

able at the cost originally estimated. However, . 



since our research was conducted, a unit of the University 
has come forward to perfect the necessary equipment'.--^'. 



The research conducted for this* study included re- 
viewing on^y the activities of projects funded in the first ' 
budget cycle (January 1978) . Appendix A also lists jp'ro-; 
jects funded in the second cycle (December 1978) . \*]&; the' ■];■'■ 
time of our research these projects were just completing, 
their first year and were in various stages of development. 
According to the Program staff, three projects in the second 
cycle had a 'portion of the system they proposed in operation 
at the time our research Was conducted, and were expected 
to complete the installation Of their. systems and fully 
. conduct their demonstrations. These grantees include the ' 
Spokane School District, the Medical Center Library "at the ' 
University of Cincinnati, and the National Farmworkers ' 
Service Center in La Paz-Keene, California.^ The blood 
bank management prbj ect being conducted bv the Tri-S tate 
Red Cross Blood Center, in Huntington, West Virginia had • 
experienced some delay in obtaining the needed equipment 
and was not yet operating. However, the System Was 
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Wisconsin determined that the interface-control device 
required to interconnect the s tor ager retrieval unit and 
the telephone lines could be acquired most economically 
> through the University of Wisconsin 1 s Physical Sciences 
, Laboratory, a design and engineering group that Undertakes 
production of specialized equipment. A design for the 
device has been developed and all necessary parts are 
off-the-shelf . Hd the necessary computer parts may 

involve delays in delivery due * to the current inability 
of manufacturers to meet demand. ;'V " % 



expected to be installed shortly, and the project was 
expected to complete Its proposed demonstration. The pro- 
ject tha^t has experienced serious difficulties was the 
s^Low- scan video and voice system for continuing medical 

education and physician consultation being conducted by 

L . • , . • . ' ' • ■ ■ ■>;{■' y': K - • v ■ ■ ^ ; . .y ., ■/■■;'.-■"; • . 

the Medical Care Development Center . The systenf origin-? 
ally proposed required licensing by the FCC which in the \ 
end was denied. The grantee has redesigned the system so 
that it' is telephone-based and will hot require licensing. 

In addition to administering demonstration projects,, 
the telecommunications Policy Of f ice has also been izj(rol ved 
in the actual promotion of the use of telecommunications 
far social service delivery/ The major activity conducted 
for this purpose was a three-day workshop on the "Use of 
Telecommunications for HEW Services," the first conference 
of I its kind sponsored by the Program. Approximately 125; V 
participants from HEW and other state /federal and local 
agencies attended. w The workshop focused on alternative 
telecommunications technologies and their social service 
applications. Also, a user forum was held to allow the 
Program's demonstration projects to present the results of 
their efforts to date. Program staff also increased their 
liaison activities with other HEW service programs to 
^increase the exposure of the demonstration projects and 
to encourage interest in the use of telecommunications. 
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3»4 lasuea^and Problems in Funding and Administering V 

The Telecommunications Demonstration Program is small, 
still relatively young, and functioning under a • rather broad 
legislative mandate . While the Program is limited to non^ 
broadcast telecommunications, this leaves 'a wide range of 
technologies to consider. Similarly, the program is man- 
dated to demonstrate ways. in which telecommunications can 
be useful in service delivery spanning the health,- educa- 
tion, ^and welfare fields. .Finally, the program has a man- 
date to support "innovative me thdds or technologies" but 
innovation may be basic Or applied in service or technology. 
In selecting and funding its demonstration pro j ects , there- 
fore , the Program has faced a number of issues concerning " 
the types, number, size, and specific purposes of the 
projects it supports. These basic issues may be summarized 
as follows: ' ' ' - 

• On what type, of innovation should the 
Program focus? 

• To what extent should the program be 
oriented to services and to what extent 
should technology development be a focus? 

• Should the Program promote telecommuni- 
cations uses that have national or local 
impacts? 



The criteria for selecting proposed demonstrations a ^con- 
tained in the regulations published by the Program provide 
an indication of the directions the Program has taken. 
Exhibit 1 lists the selection criteria and the* weighting of 
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Exhibit 1 



CRITERIA AND WEIGHTING FACTORS FOR SELECTION OF 
PROPOSED TELECOMMUNICATIONS DEMONSTRATION PROJECTS 



Criteria 



Weigh ting Factor 



w (i) That the project for which application is made 
demonstrates innovative methods or techniques 
of utilizing non-broadcast telecommunicatons 
equipment or facilities to satisfy the purpose 
' of this authority;* ' 

■ • .•• • ' • .. . '■ ' ' i\ . ;" • ■• ' :'• •" ' .' 

" (2) That the project will have 5 original research 

value which will demonstrate to other* potential' 
users that such methods or techniques are fea- 
sible and cost-effective; " 

* (3) That the services provided 1 are responsive to 
local needs as identified and assessed by the 
applicant; 11 

" (4) Tha>t the applicant has assessed existing 
teledommunicatiiDns facilities (if any) in 
the proposed service area and explored their 
use of interconnection in conjunction with 
the project; " . 

"(5) That there" is significant local commitment 
(e*g. evidence of support, participation , 
and contribution by local institutions and 
agencies) 'to the proposed project indicating 
that it fulfills local needs, and gd.vesv v some 
promise, that operational systems will result 
from successful demonstrations and will be 
supported by service recipients or providers;" 

"(6) That demonstrations and related activities' 
assisted under this section will remain 
under the administration and control of 
the applicant; " 

" (7) That 'the. applicant has the managerial and 

technical capability toi carry out the project 
. for which the application is made;"; 

" (8) That the facilities and equipment acquired or 
developed pursuant to the applications will be 
used substantially fotf the transmission, distri- 
bution, and delivery of health, education, or 
social service information,, and that use of 
such facilities and equipment may be .shared 
among these and additional public or 
other services;" 



15 



10 



10 



15 



5 f. 



i- 




(9) That the provision has been made to submit 
• * summary and factual evaluation of the 
•"• results of the demonstration at least 

annually for eadH year M which funds are 
■ • ■ received, in the porm of||a.. report suitable 
for disseminationfyto groups" representative 
. of national haal)Efr, education,, and social ■ 
services telecommunications interests;" 

(10) That the project has ootenWal for stimulating 
cooperation and sharing among institutions 
and agencies, both within and across disci- 
plines-. " - , v y : 
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factors in the selection process for the first year of 
operation. 

The first criterion as shown in the Exhibit is the 
basic legislative mandate, which has been given a sharper 
focus irf "the Program's solicitations. The term "innova- 
tive methods or techniques " in the solicitations is 'inter- 
preted to mean "the way in which' the, technology is used to 
deliver services. A J new technology' per se does not ade- » 
quately fulfill this criterion. . . new technological systems 
are not generally what is sought.'..". Thus, the Program is 
striving to focus on the service delivery mechanism and 
explicitly discourages projects that emphasize unproven 
technologies, Implicitly,, the phrase t^way in which the 
technology is used to deliver services" seems also to dis- 
courage projects that would demonstrate new services. 
Program staff have stated that their intention is 
to support projects in which neither the service nor the tech- 
nology is necessarily new (although either may be) but in 
which the application of the service and technology together 
for the first time is the innovative 'element. 

" I 

Criteria Three and Five are evidence of the Program's "': \ 
focus on the importance of providing demonstrations with a strong 
basis in. locally- identified needs. Criterion Three states that 
demonstrations must show responsiveness to local needs. "Local " x 
. is def ined. in the explanatory remarks of the solicitation 
as "specific target populations as well as geographical 

f ■ 33. 36 ■ 



loaation.r wWn .tak«n only in th« geographic sense, local- » 
need* may preclude the demonstration from having wider 
applicability. Howeyer, a: project that attempts to satis- 
fy local needs of a specific target population, and also 
shows that similar needs exist fdr similar populations in 
other locales, has reasonable potential for being repli- 
cated. Interpreting Criterion Three in this manner' in- 

...... ' • % * 

creases the likelihood that the Program Will fund projects 
that have impacts beyond the demonstration location. 

Criterion Five emphasizes the importance of local comi. 
mitment as an indicator of the need for the demonstration. 
'The explanatory remarks for this criterion define the success 
of a project, at least in part, in terms of its promise- to 
continue operation after federal funding Ceases either by 
becoming self-supporting or being otherwise subsidized. From 
the Program staff point of view, continuation as an opera- 
tionally stem is seen as strong evidence that* the project 
satisfies a real local need while providing a successful 
working model for other locations. 

Two other criteria are important indicators pf how 
the Program mandate has been interpreted. Criterion Two 
states that the project should have "original research 
value." This xs interpreted in the solicitation to mean "V 
that the /data generated will have practical value in the ° 
f urther^kevelopment of the concept o r system being deihorf- 
strated. This is distinguished fro^ a project that has a 



more scientific orientation. Stated another way, theresearch 
is to be appliad aa opposed to baaio. Criterion Ten em- 
> phasizes the significance of the institutional context of 
4 demonstration projects. The criterion and its explanatory 
remarks in the solicitation are important statements of 
the Program's interpretation of the legislative mandate.. 
The Program's enabling legislation contains no-explicit 
phrases concerning institutional impacts; however, the 



Program has Interpreted its mandate to emphasizes this factor.' ^) 
The 1978 solicitation stated in its explanation of , Cri- 
terion Ten that: "■*'..•/ 

"The institutional jlmpact...* may be one of 
the most difficult problems and important' 
outcomes of telecommunications applications. " 

This interpretation of the mandate is based on the Program 
staff's understanding of institutional problems that have 
frequently influenced the outcome of other demonstration 
efforts. . 

r 

* « » 

The Telecommunications Program therefore has for- 
mulated a basic program strategy through the evaluation 
criteria listed in its solicitations. The thrust of °that « 
strategy is: 

, v , 

m innovations the program wants .to explore '. ■ 
are of an applied rather than basic nature; 

>• - the Program's orientation is towayd devel- t .- K 
oping. service delivery mechanisms and is not ' * 

generally toward supporting development of 
new technologies; 0y% 
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8/ For a detailed discussion of thi¥ subject/ see Strategies 
for Institutionalising Telecommunications Demonstrations; 

* A Review of Innovation Barriers and Program Alternative s , 
Pinal Report #146-^04/ Kalba Bowen Associates, Inc., 1980.' 



• impact* of demonstration* art intended 
to ba both looal and to have potential 
applications Mi othar locations (i.a. 
including speoifio target populations 
as well as speoiflo locations) . 

3.5 Program Strategy Implementation .. \ 

Although the Program's projects are still in various 
stages of development, a. brief examination of the demon- 
strations with respect to the three strategy variables dis- 
cussed above is useful. It illustrates that' in its first 
funding cycle the Program may have been somewhat inconsis^ 
tent in its funding priorities, but in the second funding " 
cycle the Prog-ram seems to have selected projects that are 
more consistent with its overall strategy. 

In assessing the characteristics of each project, a 
determination has been made as to whether the technology used, 
and the service offered (as opposed to the service delivery 
mechanism) in the demonstration is applied or basic. The 
term "basic 1 * with respect to technology is interpreted to mean 
a technology that Is newly developing from an engineering 
standpoint.-—' with respect to services, the term "basic" 
is used to indicate whether the project was in some 
sense using the technology to create a new service. The 
term "applied" with respect to technology or serviclfis used 



Jj/ In interpreting the latter part of this definition, * 

interactive television is included as a basic technology 
if it was unfamiliar to the grantee or the client 
group. \ , i> \ 
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in tho opposite aenae. An .applied technology if techni- 
cally proven and relatively widely used. An applied service 
im one that already exit ta but oan bo provided in an improved 
way uaing teleoonmunioationa. 

Three projects in the first cycle can be categorized 
as employing both applied technologiea and ■ervipea. There 
is little fundamentally new about the technology or the use. 
o£ PM radio SCA for broadcaata such aa thoae provided by 
the Center for Excellence. The innovation ia that broadcaata 
are made to several apecial populations concurrently .through 
the same service. Similarly, the use of television for con- 
tinuing education ia well-establiahed, but the statewide 
network being attempted by Pennaylvania State University is 
an organizational innovation that could greatly increase access 
to continuing education programming. Likewise, the use of 
telecommunications to transmit Voice and medical data in 
emergency medical services is in widespread use. The use of 
telecommunications in rural areas on a large regional basis 
and the simultaneous transmission of voice and data are inno- 
vations of an applied nature, although radio transmission to' 
the telephone is new, which permits- calling for information 
or help anywhere in the nation. 

Other projects in this first funding cycle involve basic 
innovations .. For example , the University of Wisconsin pro- 
ject involved the development of a new automated dialing arid 
taped information retrieval system. The project, being con- 
dupted by Pace' Institute includes the use of high resolution 
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dlqw-^scan vicleo equipment. Likewis^, several other projects + 
can be considered to have created newsservices as part of the 

: demonstration. For exaxj^e, the Uqiveisity bf* Denver Graduate 1 
i Sc? k° o1 O f Librarianshi^ •-demonstration involved JdieVeloping a 
service network to share the librar^res^ufc'^s of a large urban 
center with remote libraries in small conmiuni ties; Information 

V sharing was accompli shed using slow-scan video and telefac- 
simile. This was, a new network and the provision of the out- 
reach capability was a new service . 4 A strqng argument can J 
be made .that this project really den^ 

"of. the resource sharing concept and that ..the use of telecom- : 



muhicatidris played a" very small role in the viability of ^ ; 
.that concept. Similarly; the WerAersville State Hospital 
project had as its focus the uke of two-way video to iirte- ~ 
grate cpmmunity resources for patient education Sand reha- 
bilit^tion. • Telecommunications Were to be "used to reduce 

■ • VI ' * : . « ' . - : • • ■ • . .. •• 

» • ; . ' ■ ^ .... ........ ( . • 

patient isolation and provide the mental health staff with 
patient reactivation and resQcialization assistance. This . 

■ '■ a'"- ". ■ •:. j ' ' : ' ... • 

was a, new service, an extension of the Berks County two-way 
video demonstration, and an untested concept in mehljal health 
therapy. ^ f " / \ 

The Deaf Community^ Center's use of electronic message - 
systems provides a blend of basic and applied services. 
The service is -applied in that it directly substitutes 
for' the TTY systems now used by the deaf. It is also a 
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y basic ^servifse in that it Capable of providing additional 
..." serviceg such as news an<^ consumer and health information 
in a videotertt 1 mode , . , '. " r ." ■ ' '■■ ;' ; 'V\ '' : '-'--X 

The projects funded^in the second cycle use developed 
technologies more consistently than-;.those funded in the first 
cycled ai)d- avoid creating wholly new services . Spokane ■ s ; ' 
^ educational television demonstration is innovative in system 
'ownership and program utilization patterns which enhance the 
system's programming capacity. The Tri-St ate Blood Center 

will demonstrate innovation in its existing blood management 

■ ■ , . • * ■ ' ■ '" * ".*•*. ... . .... 

program through the use of microprocessors and telephone lines 

.v Thd M^i^l^eifte r 1 s Library is building on several of its 
other 1 medical outreach service efforts to ^provide increased # 

— access from reinote—1^ 

tion and expertise. The Medical Gare Development Center 1 s 
project focuses on providing. continuing medical- education 
in remote locations of Maine through interconnection with an 
existing ^continuing education service. It uses a c.ojnbination 
of slow-sc^n TV, microwave, telephone and closed circuit TV 

technologies. . *; r 

>> ~ ' • \ ' - 

Of 1 the five projects funded in the second cycle, only 
* ■ . * * *■ * ^ * 

the National Faritf Workers Starvice Center is providing an 

essentially new. service of assistance in completing welfare 

service applications and forms such as those needed for 

... _ h . . • • ■ ' 

Sdcial' Security, food stamps ,- income tax, etc To a 
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limited extent this service was already being provided by 
the Center, in short, the Program has moved toward limiting 
innovation to applied situations, and ia reducing apme of 
the' risk involved in successfully completing demonstrations . 
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\4.0 PLANNING AND EVALUATING DEfMONSTRATI ON PROJECTS 

Demonstration projects serve multiple functions • Their;: 
most 4 iiranedi ate purpose is to change behaviors (and create 
incentives for changes in behaviors) in <a specific setting. 
Thus they provide a base for and are complemented by acti- 
cities which raise the awareness o*f federal and state pro-, 
gram managers ancMpqlicym^ers •, stimulate ^d develop policy 
changes, and provide trkining, technical assistance and network 
support for local project managers and staff. The success- 
ftll implementation qf these activities is the most direct 
method of promcpting similar applications in other settings . 



Secondarily, in fulfilling their faction as a "demon- 
stration w for oth^er locations f such projects are conducted 



to develop experience in the use of telecommunications for 
health, education- and social service delivery and to gener- 

. ate data from this experience for use in the further develop- 
ment or transfer of the innovation. Thus demonstrations are. 
at least- in part, a f or^i of experiment in which experience, 
at both the technical and organizational levels is to be 
maximized. 1st order to maximize the knowledge gained from 
the project , information collection procedures have to be 
explicitly designed to generate particular kinds of infor- 

4 matiori; this information then can be used both by project / 
managers to evolve pro jfect; goals and strategies as the demon- 
stration* develops , and by persons interested in replicating 



9 

ERLC 



the demonstration at other sites. 

. 1 The majority p£ grantees> however r have -not had exper- 

ience in the design or evaluation of any kind of research 
(i.e. data generating) projects; therefore, some projects 
^re developed such that the objectives of the demonstrations 
are not, clearly defined and important* information such as 
economic data cannot be generated. This situation suggests 
that prior to funding projects, their specific operational 
objectives should be known to both the Program staff and the 
grantee (although clearly these goals may evolve over time). 

., This should lead to both easier project monitoring and an 
increase in the knowledge gained, from the demonstration . 

4.-1 Proiect^Repj^rta^ _ 

The .purpose of the evaluation report is to document 
- the experience gained over the project's life and to deter- 
mine the degree to which the demonstration is successful in 
promoting the use of telecommunications in the delivery of 
social services. Ideally, there are' three levels, or tiers 
of success that a project can attain: 1) completing all 
intended project tasks; 2) demonstrating that the project 
concept is meeting a local need by continuing operation after 
Program funding ceases; and 3) ~ transferring the project con- 
cept to other locations. Each successive level has a greater 
impact on meeting the Program' s goal of promoting telecom- 
munications in service delivery. Of course/ levels 2 and 3 
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may, not apply to projects that, have completed only tKeir 
fir^t or second ♦year of Program funding/ so that the major- 
ity of the information contained in the grantee 1 s evaluation 
will be related to the successful completion of project task's 
It should be madenslear, however , that a useful evaluation 
is extremely dependent on a well-designed demonstration. 
That is, if a project is to produce the needed evaluative 
data, it must be designed from the beginning to generate 
that data. 

The project evaluation report should be divided in 
six sections as follows: . . - 

m Statement of the Problem; 

• Project Status; 

• Cost Analysis; 

• Barriers to Implementation and Utilization; 
Assessment of Benefits; 

• Strategies for Institutionalization. 

Statement of the Problem : The importance of properly 
and clearly formulating the "demonstration problem 11 is that 
it is the organizing principle behind the project. A pro- 
perly formulated problem statement should spell out the 
expected benefits of using telecommunications for the con- 
cept being demonstrated. The definition of the problem 
influences the types of data that are generated, activities 



of the project staff , and the types of external audiences 
that may be interested in the project. Equally important, 
it is extremely valuable in avoiding a pitfall that often, 
besets technology demonstrations: taking a technological 
solution' and finding a problem in which to use it. 

Project Status ; The purpose of this section of an 
evaluation report is to describe as specifically as possible 
how far along a project is in completing its demonstration 
agenda. Four project phases have been distinguished: start- 
up, trial operations, demonstration and institutionalization. 
Although no particular time periods fof each phase can be 
specified, these phases are not' arbitrary. They correspond 
to developmental periods in which project costs may differ. 
This portion of the report should describe project activities 
by phase. 

Cost ancj Financial Analysis ; A major argument for 
employing telecommunications in the delivery of* social 
services is that its use is cost-effective. That is , at an 

identifiable volume of service delivery, it is often less * 

* . - • . • -. 

■ , - « < 

expensive to use telecommunications to deliver services 
that to employ another method. Demonstrations must explore 

the economic characteristics of ^service delivery. The 

■ ■ ■ • . 

prima'ry purposes of conducting a cost and financial analysis 
are to: 

• Identify the structure of costs by type 
> of resource used over the four project phases; 



• Analyze cost sensitivites including 
the aubstitutability between labor 
and technology, the substitutability 
of alternative technologies ,*'and the 
effect on cost ^bf increasing the '■"/-■••V 

. volume of services delivered. over the 
demonstration system; 

• Compare the cost of delivering services t 
^ using the demonstration system to the 

costs of service delivery using other* 
existing or possible delivery modes. 

The identification of the structure of costs (e.g. 
labor, equipment, space, etc.) over time provides important* 
financial information to others who may want to adopt or 
adapt the system for their own use. - Analyzing cost sensi- • 
tivities provides valuable | data on the potential- for econo- 
mies of scale and may. permit a determination of the optimum 
size of an operational, system since demonstration often, serve 
a relatively small number of users. The comparison of costs 
for service delivery by the demonstration system versus 
other delivery methods is an analysis of cost-effectiveness.. 
It can only be conducted when data on alternative delivery 
methods are available. Because demonstration projects are 
often unique, such comparable data may not be available, 
but where it is such comparisons are the true test of 
economic viability of the demonstration concept. 

A detailed discussion of the methods, and information 
requirements for conducting a cost analysis of a telecom- 
munications demonstration project is presented in Assessing 
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the Costs of Tele^ 



Barylers to Implementation arid utilization ; 

Often there are barriers to implementing \ the demonstration 
system and utilizing it for delivering thp intended ittfor-' 
matibn services. In this portion of an evaluation report 
the barriers to implementation and utilization should be 

* *' ......... ■ . n 

d^refully documented/ The experiences encountered by 
individual projects will be extremely useful to the DemolK* 
stration Program staff in identifying pro j.ects in the 
future that may be likely to encounter similar problems.* 
It will also be useful to other organizations attempting to 
replicate the demonstration system as they may likely encounter 
similar difficulties. V* 



Barriers -to implementation and utilization may be 
classified into three categories; 

m Technical - x ^ 

• Organizational/Institutional 
> Regulatory and Legal 



Technical barriers may include obstacles such as difficulty 
in obtaining equipment , difficulty in developing or using neces- 
sary software or difficulties in establishing and implementing 



10/ See Report # 146-03, Kalba Bowen Associates , Inc., 1980. 



an effective training program. ;.» 

/ Organizational/Institutional barriers often involve' 
resistance by system users (e. g . > clients, information 
providers, etc.) to using a new technology or service, or 
difficulties in obtaining.'the" support or at least the . 
acquiescence of other agencies or service organizations. 
.Just as an innovation can be resisted by new users, it 
can also meet considerable resistance by other service- 
providing organizations that perceive tnat^e demonstration 
will have some negative impact on their activities . To - 
the extent possible actions taken by organizations that im- 
pact the demonstration should be documented. 

Legal or regulatory impediments should generally be 
identified very early in the project. These might include 
regulations, by government agencies such as the FCC, copy- 
* right laws or privacy laws. 

• Assessment of Benefits ; Assessing the benefits of 
telecommunications demonstration projects is a particularly 
troublesome tas&vt Often they are not quantifiable or even 
easily observable! frequently benefits accrue indirectly 
from action taken jasa^ result of improving access to infor- 
mation made possible by the telecommunications based service. 

Wherever possible, quantifiable measures of benefits 
should be used. The following are examples of types of 
benefit measures that may be used: 

50 



• oost savings 

- dollars per transaction, program or 
other unit of service 

- dollars per client 

- total dollars 

• productivity gains 

- volume of information per unit of time 

- units of* time saved 

- reduction in units of labor input 

• access ' :' * 

- number of potential and actual addi- 
tional clients served 

- total volume of information available 

• /-iflffiflflfc on ( client -welfare 




Care must be taken to ensure that the measures :that are chosen 
accurately describe- the service benefits received. For exampl 
additional^ hours of specialized radio programming for the 
handicapped are not benefits unless there is an audience that 
listens to the broadcasts.. That is, demonstration outputs :do 
not necessarily translate into service benefits. 

The assessment of benefits can be organized according 
to the following three points: 

• Identify the beneficiaries of the project 
(e.g., clients, service providers, admin- 
istrators) and describe how information 
services provided through the demonstration 
were previously provided. 

• Present evidence demonstrating gains/losses 
of methods and technologies employed by the 
project over previous methods and services. 

• Present evidence illustrating the compar- 
ative advantages iand disadvantages)' of 
technologies and services of the project 
versus other x available technologies and 
services. / 
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Strategies for Institutionalization and Transfer i Two 
of the ways in which the^ Telecommunications Demonstration 
Program can promote the use of telecommunications in social 
service delivery are to' encourage projects to continue 
operating after Program funding is withdrawn (i.e., to 
become institutionalized) and to transfer the demonstration 
concept to other locations that face similar service de- 
livery circumstances. In this final section of the annual 
evaluation report,, the grantee should articulate the role 
it intends to play in the institutionalization and trans- 
fer process. At the end of the first year these strata- 
gies ma» not yet be developed in detail,, but by the end of 
the second year a fully developed plan should be articulated. 

/ 

The approach to a strategy for institutionalization' 

1 

is essentially a plan to obtain revenue for continued and/ 
or expanded operation. That 'plan can vary depending on the 

thrust of the project. In addition to specific plans for ' 

y ./ 

generating revenue, the institutionalization strategy should 
also take into account other barriers that might inhibit 
long-term operations. Such barriers would likely be encoun- 
tered as part .of the demonstration but possibiy at a smaller 
scale. It will be necessary- in this portion of the report 
to identify any such barriers and the plan for surmounting 
them. " 
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5.0 INSTITUTIONALIZATION AND .TRANSFER, OF DEMONSTRATION 
PROJECTS . T " • 

On* of the Program's objectives for a demonstration is 
for it to 1)600106 "institutionalised"; that is* for it to . 
become a routine activity in one or more organizations where 
the demonstration was conducted but is no longer to operate' 
on demonstration fundi. The institutionalization of an 
innovation is evidence that the concept demonstrated has 
sufficient merit to at tract resourpes for ongoing operation. 
It should 'be noted, however, that institutionalization* does 
•not necessarily mean that the innovative approach has been 
proven J;q^ be i cost-beneficial compared to a more conventional 
approach* Also, institutionalization .should not be equated 
with "diffusion" or ' "transfer , " since it is possible for a 
service innovation to be adopted by v the demonstration agency 
but nowhere else, * / i- 

Through af review of research, we have identified several 
factors influencing /the successful institutionalization and 
-transfer v of telecommunications demonstrations. Our review 
included research specifically examining barriers to institu- 
tionalization of demonstrations and the institutionalization- 

( / ' - ■ 

related results of other recent public service experiments 

and demonstrations The research points to the following 

factors increasing the probability of successful institution- 
alization of demonstration projects: 
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/ See Strategies fori Institutionalizing Telecommunications 



Demonstrations: A Review of Innovation Barriers and Pro- 
gram Alte rnatives , Final Report #146-04- t^ik* 

Associates, Inc., 1980- 
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• established technologies should be favored; 

e the nuroSer and/or complexity of -applications does 

not materially affect the likelihood of institutionalization 
(there is some evidence that the more complex the 
application (s) , the more likely the innovation is 
to succeed) ; 01 ' ■ 

• emphasis should 'be placed in the delivery of 
services to outside users rather than the, initiation 
of changes in administrative procedures; 

• application's that do not require the sharing of 
resources or the adjustment of operational procedures 

, on the part of multiple institutions are more likely 

to succeed; however, projects undertaken by single 
. organizations with multiple service sites are more 
likely to endure than local agency projects; 



• the innovation must be initiated in response to 
locally perceived needs; - 

» top agency administrators should support the innovation; 

• those with responsibility for the diffusion of an 
innovation within the agency should participate in 
the planning and operation of the demonstration; 

• no major institutional or regulatory barriers 
to diffusion, should be present; 

• federal support should not be limited to short 
time periods (e,g. one year) ; 

• planning grants do not necessarily contribute 

to the success of service innovations; C 

e risk-sharing (in some cases including cost-sharing) 
is closely associated with demonstration ----- 



success ... 



o . From the foregoing it is clear that one of the most 
difficult managerial challenges for the Program will be 
identifying and evaluating the appropriate time and place 

for testing service innovations. There are several 

■ * 

approaches that the. Program can pursue individually or* 
collectively to increase the chances that a project will 
be institutionalized: 



1) Develop mbrg^'specific object; selection. v 
i ^ /v- ^.v; criteria andf:^evote more Resources to , , , 
evaluating proposals before they axe funded. 
'Scrutinizing the budgetary, technical ,. and 
' institutional capabilities in greater detail 
could increase the prospects for ultimate 
innovation adoption considerably. 

' 2) Directly, assist selected demonstration 

/ ; \y;V^prqje ;< 
'. v :'-':: : to;tl^ 

projects^ t s 
oriented planning^ activities; 
: steps by providing 

helping in the promotion of worthwhile 
projects, serMjtng as <v a clearinghouse for 
funding "sources or technical assistance 
in 4 >ED and elsewhere • 

V 3) Place more emphasis on tije- applicant 
V';r agency 's demonstrating that it has suf- 

ficient ties with -externaLl institutions 
and individuals who could play a role 
~. in the adbptibh or transfer of the inno- 

' .' vat ion. v f " v '" 

4) Develop a national "network" in telecom- v 
munications-related public service delivery. 
S tr eng then exi s ting efforts by 'developing 
a regular program of activities s an * 

annual conference; conducting special work- 
shops on particular service areas; encour- 
aging regular contacts among demonstration 
project staffs; managing a ^clearinghouse 
of funding and information resources . ' \.- 

Each of these approaches should be a vital component 
in the Program's institutionalization and diffusion 

strategy. But each approach requires a high staff-to- 

: :.. ■ - • . • - ' ~ . • % 

program dollar ratio. Additionally, these approaches infjbly 

■■■ . ; . . ■ . _ . •• , . ' ■ v ' I - ' \ ■ ■•?* 

that the Program should focus on a few demonstrations at 

a time; turning in overlapping cycles from one sector or use 

to another. Such constraints emphasize the need for planning 

and explicit decision-making' to focus limited resources and 

use them cost effectively. 
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6 .0 RECOMMENDATIONS 

• In the course of this study the' .problems encountered* 
in funding, selecting, and overseeing telecommunications 
demonstration projects were shown to be of three types: . 
offiamz ational — .where should the program be located within 
. DHEW (and now f ED and what should its overall mandate and- " 
focus be?; policy .-- what types of constituencies Should it 
service and what types of .impacts should it attempt to 
achieve?; and project — what projects should be selected^ 
and how should they be monitored, evaluated, and promoted 
for adoption? The following recommendations are .intended 
to guide the Program toward more effectively defining and 
realizing its mission. It is important to remember in 
reviewing these recommendations that in .some cases they 
are already being undertaken in varying degree's by the 
Program staff; in other cases, a shortage of staff , time, 
and adequate funding have prevented the Program from adopting 
more expensive and time-cons umijig endeavors . 

Organisational Recommendations : Since telecommuni- • 
cations is not" a primary service, it presents somewhat of 
an organizational problem in determining its proper pl^ce ' 
or role within an agency such as the Department of . Education. 
Therefore; whatever the decisiQns . may be as to the even- 
tual placement of the Program, they will inevitably entail 
tradepffs between concerns for treating telecommunications 



an 11 inf ras tructural M service and as a specific program 
arek. The following three recommendations are made bearing 
in 'minck these handicaps; — — — — - - 

1) High level placement of the' Program/ but 
if pbsisible! no t attaphed to a pbl icy- 
making of IE ice . I f t£is proves to be vm-l 
avoidably 

division of prpgram and policy responsi- 
bilities and functions. 



Rather than being identified with any single substantive 
area or program, the Program should occupy an organizational 7 
£lot that enables, It to encourage cooperation among agencies v V 
and programs. Alternatively,' policy functions should be separated 
from the administrative or program responsibilities and func-\ 
tions because the skills, resources and objectives of the two 1 
are distinct arid entail different staffing and administrative 
requirements . > 



2) Coritiriue needs .assessment and coordination 
procedures with other .agencies and programs 
within the Department of Education and 
the Department of Health and Human Services" 
in otder to help identify areas for cooper- 
ation, joint funding, and mutual assistance. 



Since one of the primary goals of the Program is to 

*t ■■*»* 

help agencies and programs ' to identify and ^encourage appropriate 
uses and toVpool their resources to make better use of tele- 
communications for service deliver it is important that 



. the Program* work 1 with these agencies in identifying their 
needs, assessing prdgrain priorities, and selecting 
project^ > (including joint ^projects) for funding. Not only 
should Program Vtaff work with the stifif of other programs 
in helping identify funding areas and in overseeing projects, 
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.but they should also publicize their priorities and 

* ■ ■ ■ ■■■■■ ; V ■ . , ■ ■ ; ' A 

goals to other agencies that have a potential need for 
telecommunications. These relationships need not.be highly 
formalized, but should be on 'an ongoing basis with the 
program consulting with agencies and other programs on a 
regular basis. 

3) Provide technical and informational assis- 
• tance to other, agencies and programs con- 
sidering using or funding telecommunications 
systems for service delivery, 

.* ■ _ , ■ • « 

^•Although the limited resources of the Program would 
make .a iaSr^Se technical assistance or informational support 
effort unrealistic, staff and/or contractors could be used 
both to compile information and data -for the use of other 
agencies and programs and to provide program managers and 
policy makers with "hands on" experience in the selection 
and monitoring of telecommunications projects/ In this man- 
ner the Program could become a viable focal point for exper- 
tise in the application of telecommunications to service 
delivery, thereby stimulating agencies to cooperate in pro- 
ject design and funding, ' . 

Policy Recommendations : Since its initiation, the 
Telecommunications Demonstration Program has been moving 

in the direction of funding those programs that are more 

■ P 

service-oriented and involve less technological .uncertainty . 
The following recommendations urge a continuation of that 
trend with an emphasis .on projects that have immediate end 
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user benefits and strong prospects for the pooling of 
resources to achieve economies of scale. 

4) ^ Fund projects that hav.e wide applications in 
\, the same or similar areas 

Since one of the true benefits of telecommunications is 
that it provides a conduit fqr transmission and^reception of 
all types of services regardless of content , funding and 
prpjegt opportunities should be sought out that do not depend 
upon content or context-specific applications to succeed, but 
rather involve services that are needed by a variety of 
populations with health/ social, and educational service 
delivery needs , which are bypassed by traditional market ap- 
proaches . ' . • " 7 

5) Avoid high risk pro j ec ts thai" entaijl new 

. technological developments new and untried 
software and complex and untried institutional 
arrangements among multiple organizations. 

Typically, projects examining basic technological 

t or service innovations have not succeeded in the past and 

there is* little reason to believe that they will succeed in 

sufficient vnumber in the future to justify their support, (See 

recommendation 7). ' V* 

* * .."■••■•'.*■•.*. '..?*• * 

6) Fund those projects with this potential for 
well-defined needs and strong institutional 
(not personal) incentives to succeed and. 
disseminate the results of the project. 

The results of our study on barriers to institutional- 
ization sliow that the success of many demonstration 
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projects is often contingent upon the personality and 
interests of the project director or key staff; once' they 
leave, the project dies. To limit this problem the institu- 
tion receiving the grant should demonstrate a clear need 
for the innovation or service which will encourage improve- 
ments in definition and institutional commitment as the 
demonstration develops. • 

6) Give priority to projects for vulnerable 
populations that are either not being 
served by conventional service delivery 
modes or inadequately served by current 
service delivery modes. 

Not only , are these groups more receptive to innovations 
in service delivery (since they are being inadequately served 
by current methods) , but it is often easier to demonstrate 
the value and benefits of the telecommunications components 
or such projects. 

(7) Remain open to funding some projects 
with a. higher level of risk. • 

Although the majority of projects funded shpuld 

emphasize stepwise advances in application of telecommu- 

n • a. 

nications technologies, ijt may 4 be vi6e to reserve a v 
small portion of funds to sponsor promising locaily- 
ini tinted projects that seem more risky . These special 
projects could be given small amounts of seed monies 

to complete feasibility studies to determine whether addi- 
tional funding should be forthcoming. However, if such a 
project successfully demonstrates its feasibility, then it 
should have a very high chance of receiving support the 

) - . v . 



second year. 

Project Planning and Oversight Recommendations v The 
success of a Program in managing and monitoring its^ projects 
is in large measure determined by the amount of time the 
staff can put into their oversight responsibilities. The 
amount of time required to monitor projects , however, can 
be reduced to some extent by investing tirje from the outset 
in the selection process .-- such as looking for those pro- 
jects that have demonstrated experience in the area/ strong 
institutional incentives to succeed, control over critical 
resources affecting project outcomes, and/or a minimum of 
outside conflicting commitments. By carefully screening 
projects from the outset, the likelihood of failure as well 
as the amount of time required to oversee and assist pro- 
jects in progress can be reduced. As pbinted out earlier, 

the Program is already engaged in the majority of efforts 

■ • 

outlined below. They are mentioned here to stress the 
importance of continuing efforts in this direction. 

8) Establish ^rom the start the objectives 
and measures of success for projects to 
be funded so that projects can be evaluated 
in terms of the Program's overall goals 
and assessed for the it level of risk, ex- 
pected benefits and requirements. for tech- 
nical assistance. 

A deliberate attempt should be made to select a mix 
of projects in terms of their level of risk so that pro- 
jections can be. ma&e as to 'the amount of staff time required 
for monitoring and assistance. s 



9) Conduct workshops with projects so that 
they can be made aware of what is expected 
of them, share their experiences with other 
projects, and more effectively manage their 
projects. / : 1 

ThesS^workshdjps allow Program staff as well to get a 4 
better sense of a project's capabilities and its^potential 
needs for assistance. 

10) Establish explicit criteria- for feasibility 
assessment so that projects, in the first 
year anticipating second year support know 
what is expected of them. 

One of the difficulties in attracting^ experienced peopl 
into demonstration projects is that they are wary of com-,* 
mitting themselves to major projects that are often funded 
for only one year. In order to attract the best proposals, 
an effort should be made to inform prospective projects of * 
the criteria they must meet in order to qualify for second 
year funding. 

J 

11) Develop a standardized evaluation form for 
major types of projects (by objectives, tech- 
nology, and service). * 

* Work with projects in explaining what the evaluation 
forms mean, how they are to be filled out, and their im- 
portance for the Program and thfe continued support of the 
project. 

12) Involve related funding agencies with 
substantive expertise in service areas to 
help evaluate proposals in overseeing 
projects. 



Careful consideration , however, should be given to 
drawing upon the expertise of the agency that is appropriate 
to the project evaluation so that the time and effort of 
agency and Program staff is not wasted on extraneous prob- 
lems and issues. Since different agencies have different 
levels of interest (for example, policy makers and staff 
a're primarily interested in the initial phases and final 
phases of a project whereas specialists, are concerned with 
implementation, issues) , an effort should be ma.de to involve 
different groups and constituencies in those phases and 
issues that are appropriate to their, expertises. 

Although many of the recommendations made in this 
final section can be taken individually, they nonetheless 
are a part of a larger strategy towards funding and over- 
seeing demonstration programs. This strategy is in part 
a ^continuation of the strategy already . evolved by the Program. 
The emphasis is upon clarifying and sharpening the Program's 
mandate a^nd having it work more efficiently with its limited 
resources with other agencies within DHEW and/or DOE. « The tech* 
niques suggested here and throughout the. report are intended to 
help the Program deal more systematically and explicitly with' 
some of the problems it has encountered. Although these 
recommendations were made with' jregard to the Program's current 
location with DHEW, we expect; that m&ny of them will be equally 
valid "now that the Program has been moved to the Department 
of Education. ^ 
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Appendix A 



Summary Deeoriution of Telecommunication Demonstration Projeote by Initial Ending Cycle 



Grantee 

Center for Excellence 
Williamsburg, Virginia 



Te^ 



nltlal Funding -^January IS, 1976 



Type of Institution 

Private non-profit 
service organise 
tion 



• Type of Service 

News, enter tatnment, announce- 
ments and educational infor* 
nation aeryicetfto the deaf/ 
blind and homobUind. 



Tec i no logy 
>loyed 



FMWadio 8CA/ 
auiio reoeliver/ 



Project Statue 

Continuing - eyetem 
operetioneli 
received third year 
continuation funda, 



Deaf Community Center 
Roman Catholic Arch- 
diocese of Boston 
Framinghaa, Masaachu- 
setts 



Private non-profit 
service organizar 
tion 



Electronic mailbox and inform 
mation services for the deaf, 



Computer/ 
telephone* 



Continuing - eyetem 
operational; 
received third yeer 
continuation funds. 



Graduate School of 
Librarian ship 
University of Denver 
Denver, Colorado 

Telecommunications 
Division 
State of Alabama 
Montgomery, Alabama 



Werneraville State 
Hospital 

Werneraville, Pennsyl- 
vania 



PACE Institute, Inc. 
Chicago, Illinois 



Educational institu- 
tion 



State agency 



State mental health 
institution 



Private non-profit 
service organiza- 
tion. 



Information resource sharing 
among libraries. . . 



Emergency medical service 
communications for rural areaB. 



Patient education and rehabil- 
itation programming, 



Educational services for inmates 
in correctional institutions. 



Telefacsimile/ 
slow-scan TV/ 
telephone 



UHF radio/ 
telephone 



TVQ-wa,y cable/ 
microwave JLink 



Two-way b low- 
scan TV/tele- 
phone 




Completed * results 
being disseminated, 
system not continuing 
in full operation* 

Applied for 
year of 
equipment 
Demonstral 
pleted; en£ 
continuing to operate. 

Continuing applied 
for only one year of 
funding for equipment 
purchase) two-way cable 
system in place to . 
provide programming. 

. Continuing - system 
partially operating. 
Project received 
third year continuation 
funds. 
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frl* of jnrttUUon 



flfH Site! 



Technology 



Proj»ot status 



7* ftnnsylvanla state 
University 
University Park, 
Pennsylvania 



fltata educational statevidu continuing education 
institution; n^rk, 



8. Extension System state educational 

University of Wisconsin institution, 
Madison, Wisconsin '-. 



Dial-up information lervicsi, 



Cattle tela- 

vlnion/micro- 

vaw 



Automated dial 
access tele* 
phone infor- 
mation eyetum 



Continuing - beginning 
operation, Project did not 
gat aaoond year funding but 
received third year con- 
tinuation fundi* 

Propoaad technology wai riot 
fully developed, No aaoond 
yaar funding raqueatedi 
third year funding received 
to oonplete daaonatratlon, 



Initial Funding ■ Duceeter 15, 197B 



9. Spokane School 
District 181, 
KSPS-TV 

Spokane, Washington 



10. Tri-State Red Cross 
Blood Center 
Huntington, Hast 
Virgiika 



Public school 
system. 



Private nan-profit 
medical sorvice 
organlza^pn. 



Elementary, secondary, post 
secondary and health educa- 
tion services. 



Blood inventory management. 



Cable TV/two- 
way cable TV 



Continuing and par- 
tially operating - 
project received 
aaoond year continua- 
tion fundi. 



Microprocessors/ Continuing but not 
telephone, yat operating, 



. 11. Medical Centers 

Library 
University of 

Cincinnati 
, Cincinnati/Ohio 

12. National Farmworkers 

Service Center, 
Inc. 

U Paz-Keene, 
California 

13. Medical Care Devel- 
opment Center, Inc. 

Augusta, Maine 
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State medical health 
institution 



Private non-profit 
service organization. 



Medical service , 
organization. 



Access on request by health 
professionals at remote sites 
to medical information at 
major medical center* 



Information dissemination 
on bocUI and welfare 
services for migrant farm 
workers, 



Continuing medical education 
and medical consultation. 



Slow-scan TV/ 
telephone 



Microwave/ 
telephone 



Slow scan TV/ 
FM radio sen/' 
microwave/ 
closed circuit 
TV/telephone 



/ 



Cdnt 



Continuing and oper- 
ating • project 
.received second year 
continuation funds. 



Continuing and 
operating, 



Continuing * project 
delayed because FCC 
license was not granted. 
Delivery system was re- 
designed and funding 
released. 
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In September , 1978, Kalbat Bowen Associates was awarded 
a coritract from the Office o£ Telecommunications Pblicy (OTP) 
of the Department of Health, Education and WeJLf are 
• evaluate the first eight demonstration projects funded ; during 
the initial year 1 of OTP 1 s Telecommunication^ Demonstration 

/ Program*. The specific goals of Kalba Bowen, 1 s research were / 

• "■' • * . 

to : • 



review and evaluate -the activities of 
the Program to dafce and develop approaches 
for analyzing and evaluating -individual* 
demonstration projects in the future; r 

identify factors that. have an influence 
over the successful institutionalization 
and transf ey of innovative ,uses of tele- 
communications; and '-■ 

provide infoimation on which to base future 
actions -for Program development and offer f 
recommendations concerning future roles for 
the Program. / ' , I 



Itesearch conducted during this eighteen montl* project 
included site visits with the demonstration projects'; / 
detailed site evaluation forms pompleted^y demonstration 
project' personnel; personal interviews with* policy ^makers, 



f und er s, , • te lecoiraQuni ca ti on s project directors*, and social 
service deliverer^ in, other fields; telephone ' interviews 



„wi4& .tyelv^/J^^fe^-ip ' other ' fie ids > telephone interviews • 
. using telecq^u^t options'; ongoing personal and telephone con- 
tact wi£h aaditeidnal experts in' ^telecommunications . * ' 
and sbb!La v i service delivery; cost benefit analyses; 
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; literature reviews; and utilization' hf Kalba Bowen's internal 
£ersfe>nnel expertise and resoufcesv 

' Vr ••" . * . . ■ ■ 

■ ' • • ■ : ■ 0 ■ ■ 

Research results have been, prepared In three separate 
reports. These. are: V ' ' v v > A . 

t ' • . Evaluation of Telecommunications Demonstration 
Projects and Recommendations for the PHEW >~ 
Telecommunications Demonstration Program ; / 
• .-i , ■ * ■ . . , 

• Planning and Evaluating Telecommunications N ^ 
*' Demonstration Projects and Assessing the '"Costs 

of Telecommunications Demonstration Projects ; 
• ■ . .' ■' ■** ■ ■> '■ 

• Strategics for Institutionalizing Telecommunications ' 
Demonstrations: A Review of Innovation Barriers 

and Program Alternatives . . - 

r . ;.. - ' 5 . - 

The findings of these reports and Kalba /Boweh's recommenda- 
tions to'OTP concerning future directions for the Telecbmmuni- 
cations Demonstration Program are summarized below, 

; > . ... 

'* ' •%'.•'. .> \ 

: ? ... ■■ . 

, Summary of Program Activities . » fc 

Exhibit 1 summarizes the demonstration projects included 
in-Kaiba Bowen's inquiry. As the exhibit indicates." these 
proj^qts wer.e undertaken by a variety of institutions 
ranging from private, non-profit service organizations to 
educational institutions; types of services included e'mer- 
gency medical care, continuing education, and resource 
management; technologies employed ranged from telephone- 
< computer links to the FM'subcarrier band to two-w^y c^abjjs. 
At the titae Kalba Bowen completed its research/ two of the 

■ . . . . ■ ■ . * • « ' 
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Summary Description of Telecommunication Demonstration Projects by Initial Funding Cycle 



Initial Funding - January 15 f 1978 



Grantee * 

1. Center for Excellence 
WiHiamsburg, Virginia 



Type of Institution ' 

Private non-profit 
service organiza- 
tion . 



Type' of Service 

News, entertainment, announce- 
ments and^educationaUnforr- 
nation services to the 'deaf ) 
blind and homebound. ;■" 



Technology 



Project Status 



FM Radio SCA/ Cpntinujtig - system 
-audio-receiver/— operational) 
TW received third year 

continuation funds, 



2. Deaf Community Center 
Roman Catholic Arch- 
diocese of Boston 
, Framingham, Mjjssachu- 



Private non-profit 
service organiza? 
tion 



Electronic, mailbox and in for- , Computer/ 
nation services for the. deaf , telephone, 



setts 



Continuing - system 

operational} 
received third year 

continuation funds. 



3 ; Graduate School of 
Librarianship 
University of Denver 
Denver, Colorado . 

4. Telecommunications 
Division' 
State of Alabama 
'Montgomery, Alabama 



5, Nernersville Sta 
Hospital 
Hernersville, Pennsyl- 
vania y 



Educational institu- 
tion 



State agency 



State mental health 
institution 



Information resource sharing 
among libraries. 



Emergency medical service 
communications for rural areas, 



Patient education and rehabil- 
itation programing, 



Telefacsimile/ 
slow-stan TV/, 
telephone 



UHF radio/ 
telephone 



tyQ^y cable/ 
raicrowaye link 



Completed i- results 
being disseminated, 
system not continuing 
in full operation. 

Applied for only one 
year of funding for 
equipment purchase. 
Demonstration com* 
pleted; entire system 
continuing to operate, 

Continuing - applied 
for only one year of 
funding for equipment 
purchase) two-way cable 
system in place to , 
provide programming. 



.6. PACE Institute, Inc, 
Chicago, Illinois 



Private non-profit 
service organiza- 
tion. 



Educational services for inmates 
in correctional institutions. 



Two-way slow- 
scan TV/tele- 
phone 



Continuing r system 
partially operating., ()| 
Project received 
third year continuation 
funds, 



Grantee 



7. Pennsylvania state 
University' ' 
University Park, 
Pennsylvania 



Type of Institution 



State educational 
institution. . 



8. Extension System state educational 

University of Wisconsin institution. 
Hajlaon, Wisconsin 



Type of service 



"Statewide continuing education 
network, 



Dial-up information services, 



Technology 
Employed 

Cable tele- 

vision/micro- 

wave 



Automated dial 
access tele- 
phone infor- 
mation system 



Project Status 

Continuing • beginning 
operation, Project did not 
get second year funding but 
received third year con* 
tinuation < funds, ' 

Proposed technology was not 
fully developed, No second 
year funding requestedi 
third year funding received 
to complete, demonstration • 



Initial Funding - December 15, 1978 



9. Spokane School 
Pistkct 1(1," 
KSPSfV 

Spokane i Washington 



10. Tri-State Red Cross 
Blood Center 
Huntington, West 
' Virginia' 



Public school 
system. 



Private non-profit 
medical service 
organization. 



Elementary, secondary, post 
secondary and health educa- 
tion services. 



Blood inventory management. 



Cable TV/two* 
way cable TV 



Microprocessors/ 
telephone. 



Continuing and par* 
tially^perating - 
project received 
second year continua- 
tion funds. 



Continuing, but not 
yet operating, f 



11. Medical Centers 
Library 

University of 
Cincinnati 
Cincinnati, Ohio 

12. National Farmworkers 
Service Center, 
Inc. 

La Paz-Keene, 
California 

13. Medical Care Devel- 
opment Center, Inc. 

Augusta, Maine 
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State medical health 
institution 



Private non-profit 
♦service organization. 



Medical service 1 
organization. 



Access on request by health 
professionals at remote sites 
to medical information at 
major medical center. 



Information dissemination 
on social and welfare 
services for migrant farm 
workers* 



Continuing medical education 
and medical consultation, 



Slow-scan TV/ 
telephone 



Microwave/ 
telephone 



.Slow scan TV/ 
FM radio SCA/ 

i, microwave/ 
closed circuit 

} TV/telephone 



Continuing and oper- 
ating ■ project i 
receifahtownd year 
continuatiSiT funds. 



Continuing and 
operating. 



; Continuing - project 
delayed because FCC 
license was not granted. 
Delivery systeti was. rev 
designed and funding 
released! 
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thirteen projects funded in 1978 had been completed; eight 
were continuing as planned and were in various stages of 

• 9 

development; and three were either not operating and/or ' 
required major modifications in the original demonstration 
design. 




OTP's selection of demonstration projects is based on 

the following three strategic components: 

.... • % 

m innovations to be demonstrated are of an ~" 
applied rather than basic nature; 

• the^ Program is oriented toward service 
delivery mechanisms and is not generally 
supporting development of new technologies ; • ~ ' 

• impacts of demonstrations are intended to 
be both local and to have potential applications 
in other locations with similar populations 
and/or service needs. 

When one considers the range of possible program 
strategies OTP could have chosen, the current strategy 
can be seen as one with relatively low risk v However , when 
seen in the light of organizational and budgetary constraints 
there are several reasons for concluding that it is an appro- 
priate basic strategy.. First, the Program's appropriation 
*-is relatively small, and in real tenhs it is getting smaller. 0 

1/ . ' 

— Congress provided $1 million for each of the first three 
years. That funding level Is expected to remain the 
same through fiscal year 1981. 



With inflation running at such a high rate, each year the 
Program can buy leas and less with its Program budget. 
Second, the Program has" a cross-cutting mandate that includes 
services in many health, education, and welfare agency pro- 
grams. Funding only one or two large projects would make it 
very.vdjfef ficult to serve that mandate. Third, the Office of 
Telecommunications Policy has a small staff whose time is not 
entirely devoted to the Program. Currently, two perions 
share responsibility for its direction, and both- have respon- 
sibilities outside the OTP. Two other staff persons largely 
oversee the day-to-day administration of the Program, but 
they have other responsibilities within OTP such as involvement 
in inter-agency committees. Thus, it is unrealistic for OTP 
to adopt a strategy that would involve considerable resources 
in active direction of projects or .in large scale efforts to 
affect the adoption or innovation process. Finally, the Program 
recently has been transferred into the new Department Of Edu- 
cation. Facing the uncertainty of reorganization, making 
long-term commitments of program resources for a limited 

number of projectsjwould be risky. — - 

* * * 

Planning and Evaluating Demonstration Projects 

• A* . ■- • . 

Demonstration projects serve multiple functions. Their 
most immediate purpose is to effect behavior changes in a 
specific -'location.- Secondarily, in fulfilling their function 
as a "demonstration" for other locations , such projects Ire 



conducted to develop experience in the public service use of 
telecommunications and to generate data from this experience 
for use In the future development or transfer of the innovation. 
In order to maximize knowledge gained from the project, infor- 
mation collection procedures have to be explicitly designed 
from the start of a project to generate particular kinds of 
information; this information then can be used both by project 
manage^s-^p evolve project goals and strategies as .the demon- 

.ration develops, and by persons interested in replicating 
:he demonstration at other sites. 

Two strategies were developed by Kalba Bowen Associates 

to help demonstration projects standardize and simplify 

tMeir evaluation ,ef forts. KB A suggested that a project 

evaluation report, which should be submitted by project 

directors on an annual basis, should be divided into six 

sections: 

W- ' ^ • ' ' 

• Statement of the Problem; ^ 



• Project Status (Start-up', Trial Operations, 
Demonstration or Institutional Phase) 

• Cost Analysis; 

m Barriers b to Inplementation and Utilization;, 

• Assessment o*f Benefits; and 

• Strategies for Institutionalization. 

While the particular objectives of demonstration projects 
may lead them to emphasize one or more of thes^vinfcprmation 

4 

areas, efforts should be made by grantees to be as detailed 



as possible in reporting in all these topics. The types 
of information required in each report section are detailed 
* in Planning and Evaluating Telecommunications Demonstration 
Projects . -2/ 

In addition to suggesting evaluation reporting procedures, 
Kalba Bowen developed a methodology for assessing the costs 
of telecommunications demonstration projects. The methodology 
is organized, around four major element* of analysis: 

e Determination of true costs; 



~Jt4 Disaggregation^of costs by input and by time; 

• Sensitivity of wsts and output to variations or 
substitutes for inputs; and 

• Consideration of technological characteristics 
of the demonstration. * 

A detailed discussion of the methods and information V 

requirements for conducting a cost analysis is presented in 

Assess ing the Costs of Telecommunications Demonstration 

Projec ts.—^ * 

" ' ' - ( 

Barriers to the Institutionalization and Transfer of 
Demonst ration Projects 

In shaping its overall demonstration strategy, OTP/DHBW 
(and now DOE) must be sensitive to -a variety of factors 
which may affect its ability to be institutionalized 



1/ 

Report #146-03, Kalba' Boweh/Associates, Inc., 1980. 

2/ . 
• Ibid. 



and transferred to cither locations. (These factors include 
the Inherent characterlstic^of an innovation, the organizational 
environment in which the innovation takes place , and specific 
implementation procedures. Through a review of research V 
specifically examining barriers to the institutionalization • 
of demonstrations and the institutionalization- related 

results of other recent public servic^ demonstrations, KB A 

, i » 

identified the following facttass as increasing the probability 
of successful "routinization" of demonstration projects: 

• » 

• established technologies should be favored; 

• the number and/or ^complexity of applications does 

, not materially affect the likelihood of institutlonalizatic 
j (there is some evidence that the more complex the 

application (s) , the more likely the innovation is 
, . ^ to succeed) ; i 

• emphasis should be placed in the delivery of 
services to outside users rather than the initiation 

* " of changes in administrative procedures; % ' : 

• applications that do not require the sharing of 
resources or the adjustment of operational procedures 
on the part of multiple institutions are more likely 
to succeed;* however, projects undertaken by single 
organizations' with multiple service sites are more 

. . likely to endure than local agency projects; 

• the innovation must bfe initiated in response to 
locally perceived needs; 

»• top^^ency a<toinistrators should sup)a{3rt the innovation; 

• those with responsibility for the diffusion of an 
innovation within the agency should participate in 
tnie planning and operation of the demonstration; 



• no major institutional or regulatory barriers 
to diffusion should be present; 

* * * 

e federal support should not be limited to short 
time periods (e.g. one year); 

/ e planning grants 'do not necessarily contribute 
to the success of service innovations ; 

e risk-sharing (in some cases Including cost-sharing) 
is closely associated with demonstration success. 

■J . 
These issues are discussed in detail in Strategies for 

C Institutionalizing Telecommunications Demonstrations-^ A 

Review of Innovation Barriers and Program Alternatives .-^ 

Recommendations 



In the course of .this study the problems encountered 
in funding , s electing * Po ahd overseeing telecommunications 
demons tratipn projects were shown to be of three types: 
organizational , — where should the program be located within 
DHEW (and now OOE) and what should its overall mandate, 'and I 
focus ±>e?; policy — what types of constituencies should it 
service and what types of impacts should iijb attempt. t6 
achieve?; ,and* project --.what projects shpuld be selected' 
and how should the^ sbe monitotfed, evaluated, and promoted 
for adoption? The following recommendations" are intended 
to guide the Program toward, more effectively defining and 
.realizing its mission. It is important to remember in 
review,in9 thesq recommendations that in some cases they 

4/ ' . 

— ■ Report, #146-0.4, Kalba Bowen Associates, Inc., 1980. 
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are already being undertaken in varying degrees by the 
Program staff; in cfther cases, a shortage of staff,- time, 

« 

. and adequate funding have prevented the Program from adopting 
more expensive and time-consuming endeavors. 

Organizational Recommendations ; 



1) Highr level placement of the Program, but 

if, possible not attached to a policy- . 
making office. If -this proves to be un- 
avoidable,- then there^ should be a clear 
division of program and policy responsi- 
. bilities and 1 functions. 

: . ■«•',. k 

Rather than being identified with any single substantive 

; » '. 

area or program, thd Program should ocqtapy an organizational 
slot that enables it to encourage cooperation among ^agencies 
and programs. Alternatively, policy functions should be separ- . 
ated from the administrative or program responsibilities and' 
functions because the skills, resources and objectives of the ; 

SF 

two are distinct ,and entail dif^r^nt staffing and administrative 
requirements. *. 

2) .'Continue needs assessment and coordination 
procedures, with other agencies and programs 
r.\'.,„ within .the Department of Education and the " . 

.Depar£foent of Health arid' Human Services in 
•? order to help identify areas for coopera^i/ 
r ' tion, joint, funding.; artd mutual assistance 3 : 



It is important that the Program work, with other ' agencies in v 
identifying their needs, assessing program priorities, . 
selecting projects (including j'oint projects ) for- funding 
and overseeing projects. It should also publicize its ^ 
priorities and goals to other agencies that, have a potential 



rt^ed for telecoi%inic|±ipnl.^ .Y/'v- '•" 



s ' m f* € . a \ ar ^ e te< ^nica;|[ass^ 

could be used, 




. agencies and^programs ^ In • .tfedaj &ja%fe Ingram/ could become ' 

a^^e ; fo6ai : point'£drfc „f. 

t^ieco^untcat^ons tV mefccem^^^ * , 

V:^J%icxe?; ; to .^operate ;^J^ '' " ; .'• •• \- 



policy Recommendal^S :i ' 



4) Fur^ projects ithat haVe ; iwdUe^ap^li cations in 
tlm s ame .8^ .sinfirar . areasi : ' ; 



• • f s i nce °ne of «ie true, benefits of - telecommunications is 
V : that it provides ^^co^uit foif transmission and reception of 

f unding and 

^• : '*fe^9^^^9^1^un±.^Les'. 4^o^(d. bfe^s ; ou§hfc out that do riot depend 
upon content or coiitext-ispecif ic applications to succeed. 



5 ) . , Avoi ^ hi ?b risk projects that entail new 
■ • '. technological developments, new and untried '•' ' 

software and, complex, and untried institutional ■"' fa 

arrangements, among multiple organizations. 

■ ?dV." ••• - "V •' • • .. ; •■• . .- 

Typically, projects examining basic technological 
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or service, innovations have not. succeeded' in the past and- * 

f>l ' .■ " ■ u^. ■ * ■ . • ■ ' ' ' * >. ** .} . ■ ■ ■ • ■ . 
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* there is jlittle reason to* believe' that they' will- succeed in 

sufficient number in the future to, justify their support. 

■ • : -nr • ' • . . ■ : ' • .... ■ / .■ . •••• , ■ 



'4:' *. 



6) '^uhd f those projects with the potential for 7 
\ well-defined needs tand strong institutional . ■ 
■ V ( not -person al ) inqiht iy es to succeed and ' ? 

.disseminate; the .results of the project. . :V< V* ?T' S 



To .limit the prospect of a project collapsing Once key stajf f i^ve 
the institution receiving the grant shoulcl^dempnstrate a ..clea^-- 
need for the innovation or service ^hich.will encourage, 
institutional comntitment as the demonstration develops.- 

■H^ .... . "l? ■ • ■ ■ K ' " 

. 7) Give priority to pro jec^s^f or j^ulatiosisT \ 
that are either not being served 1 by con- * 
ventional service delivery modes or inade- 



quately serve,d by o current setyi^ce delivery 
notes (handicapped, . el^erly^e^^ ) v • " ;f ..- . .. . * 



Not only are these groups more^&^ innovations , 

5 in service delivery (since they are being "inadequately *&erve 



by current methods) , but it is'bf ten /.easier to demonstrate ^ 
\the value and benefits of Ihe telepominun^ \ 
.of such projects. /■ ^ > ' '* ^ , ' . - / S^.^ * * 

<P 8) Remain open to funding some projects with \ * 
' ,a higher level of risk-, &\ ^ * \ 

It ¥ may : " tfee wise to, reserve, k small portion of funds to 1 sponsor 

\r- - • ' V '? v -. '. ., ■.' "'V. ' 

promising -locally; initiated projects, that seem more risky. 

These special projects would be required to fc complete feasibility 

JpEtudies to determine whether additional funding should be 

If such a project successfully demonstrates 

itSg^easibility, then it should" have a yery high chance of 

.receiving support the second year. 
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■ ity.^ v • , . . . . : ....... . . ■ ' 

* Project Plapning and Oversight Recommendatidns : 



"9K Est^li^h ^roiri the staSSt the objectives 
\, and measures of success for projects to 

be^unded so that projects cam be evaluated 

in terris of the ;Programfs overall goals ; 
. find assessed^ for their 'level of risk, \ 

expected benefits and requirements for 

technical ^assistance 



r - * 



. V -:A deiJ|]^:ate attempt should be made* to select £ mix 
"f^of projects in 'terms of their* level of risk so that " 
projections can be made as to the amount of staff tilne 
p required for monitoring and assistance. 

v id )' Conduct workshops with projects ^ t^tiat 
'. , ';\ V : they can be made aware of what is expected ' 
v " - . of them/ share their experiences with other 

'■/''■:.:-<..■.:*' project^, and more effectively manage their 
projects , , 

/ These workshops allow Progi&in staff, as well ,t6 get a 

better sense of a project's capabilities ^nd/iSs potential 
needs for assistance. ^ 



11*| Establish explicit criteria jEor feasibility 
asses sWnt sbt that projects in the first 
■ Anticipating 'second, year support know 

^h^fe^^;; (expected of theiru ' 

In .ordS^^of attract the bes ; t propos a Is , <.mi^^fo rt 



should be made to inform prospective* projects of- theb 
criteria; they must meet in order to "qualify for second 
year ' funding. » 

12) Develop a standardized evaluation form for 

major types of projects (by objectives., tech-. 
% \ nology, and service) . # * . 



. .,. Work with prefects in explaining*^ 

• •'.'>'/• ' ■"' : .' ■ ; " ^^^^ - ; . 

forms mean, how they ar.e to be filled out f and thei F r *i^ 

for the Pp§|fram and -the continued support of the ptd^W^ . V ' ■ '-y-:] 

— i : ' \''\^J . -\ .... ''■'>'•' ,'. ' ••: 

13) ; 4 Involve related funding agencies with - / 

,/ v ^^s^ft*antiw expertise in, service areas - 

.; ; ; to help evaluate proposals and oversee ; : * * 
pickets. . v _i_ • ■■' • ; ' \ 

; : * • § ^^Se;; different agencies have different levels of interest V 

/ '' ■ ■ •• j •■' # f m ■ ■ . ■ ■ 1 ' ' / ■• . • \ 

(fdr example;* policy makers and staff are primarily interested 
in/-^^;i|^i;tx^l. phases*#nd, ; final phases of £ project whereas 
spWqi^i-s^s ; . aire ctatfcei^ issues) A an - -\ I 

e^prt i should ^^a4ft/i^^ involve different groups and cbn- 
slitu^cies ^^ix^|y^ft ; ^hases and issues " that dre appropriate 

* : ^I^I^^MW'^^? of these reconune^dations can be taken 
^ ' i^^i^i^^^iy^ ttiey nonetheless are a part of a larger 

demonstration 

" P£o##^ a continuation of the 

7 str4t^|^ aire evolved by the Program. The techniques 

:!h ' ' . •■' : : * > ^ , . "'. 

^isii^g^t<^d here and throughout the' repdrts are intended to V 

program deal mofe systematically anil explicitly 
-wit^v^^ne of the problems it has encountered. Although thfe^e 



i. 
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recommendations were made with regard to urogram' s 
lpcatxbn with DHEW,/we expect that majay of them will' be equally 

valid: now that the Program has been moved to the Department 

'J % ' ■ ■' • ' .,. V ' 

of Education. 

VS$¥ -- .... ? . . ' . _ ^ J -■ ' ' ' ^ , ' . 



